-- Logs begin at Wed 2022-07-20 08:55:59 UTC, end at Wed 2022-07-20 09:52:46 UTC. -- Jul 20 09:21:35.458433 dv-cinder-822822-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 09:21:35.465769 dv-cinder-822822-3-smb devstack@keystone.service[80094]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 09:21:35 2022] *** Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: nodename: dv-cinder-822822-3-smb Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: machine: x86_64 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: clock source: unix Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: pcre jit disabled Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: detected number of CPU cores: 4 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: current working directory: / Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: detected binary path: /usr/bin/uwsgi-core Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: your processes number limit is 47680 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: your memory page size is 4096 bytes Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: detected max file descriptor number: 2048 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: lock engine: pthread robust mutexes Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: thunder lock: enabled Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 09:21:35.470077 dv-cinder-822822-3-smb devstack@keystone.service[80094]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 09:21:35.513226 dv-cinder-822822-3-smb devstack@keystone.service[80094]: Python main interpreter initialized at 0x5641c9fb89c0 Jul 20 09:21:35.513226 dv-cinder-822822-3-smb devstack@keystone.service[80094]: python threads support enabled Jul 20 09:21:35.513226 dv-cinder-822822-3-smb devstack@keystone.service[80094]: your server socket listen backlog is limited to 100 connections Jul 20 09:21:35.513226 dv-cinder-822822-3-smb devstack@keystone.service[80094]: your mercy for graceful operations on workers is 90 seconds Jul 20 09:21:35.513601 dv-cinder-822822-3-smb devstack@keystone.service[80094]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 09:21:35.513679 dv-cinder-822822-3-smb devstack@keystone.service[80094]: *** Operational MODE: preforking *** Jul 20 09:21:35.513915 dv-cinder-822822-3-smb devstack@keystone.service[80094]: *** uWSGI is running in multiple interpreter mode *** Jul 20 09:21:35.513915 dv-cinder-822822-3-smb devstack@keystone.service[80094]: spawned uWSGI master process (pid: 80094) Jul 20 09:21:35.514119 dv-cinder-822822-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 09:21:35.515631 dv-cinder-822822-3-smb devstack@keystone.service[80094]: spawned uWSGI worker 1 (pid: 80105, cores: 1) Jul 20 09:21:35.515631 dv-cinder-822822-3-smb devstack@keystone.service[80094]: spawned uWSGI worker 2 (pid: 80106, cores: 1) Jul 20 09:21:35.515631 dv-cinder-822822-3-smb devstack@keystone.service[80094]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 09:21:41.015489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:21:41.015489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: from cryptography.utils import int_from_bytes Jul 20 09:21:41.016318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:21:41.016318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: from cryptography.utils import int_from_bytes Jul 20 09:21:41.016318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:21:41.016318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: from cryptography.utils import int_from_bytes Jul 20 09:21:41.016809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:21:41.016809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: from cryptography.utils import int_from_bytes Jul 20 09:21:41.065108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:21:41.065275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:21:41.065351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:21:41.065438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:21:41.065508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] command line args: [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:21:41.065634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] command line args: [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:21:41.065786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:21:41.065915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:21:41.066000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ================================================================================ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:21:41.066123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ================================================================================ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:21:41.066208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] admin_token = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] admin_token = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config_dir = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_dir = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config_source = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.066996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] debug = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_source = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] debug = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.067984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_config_append = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.068955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_config_append = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_dir = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_dir = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.069991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.070987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.071952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.072122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.072206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.072371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.072452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.072645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.072736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] publish_errors = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.073972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] publish_errors = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] standard_threads = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.074983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] standard_threads = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_journal = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_json = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_stderr = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.075932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_syslog = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_journal = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_json = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.076589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_stderr = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_syslog = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.076803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.076957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:21:41.077042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.077984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.078992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.079991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.080961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.081942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.082904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.083057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.083134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.083296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.083373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.084863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.085973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.086994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.087948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.088894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.089991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.090926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.091955 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.092973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.093871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.094852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.095973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.096922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.097952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.098901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.099056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.099145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.099856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.099940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.100873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.101993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.external = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.102964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.external = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.password = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.token = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.103947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.password = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.token = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.104989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.105929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.106881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.107974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.108882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.109932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.110917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.111872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.112925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.113889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.114923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.115967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.116959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.117957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.118974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.119935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.120974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.121878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.122921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.123999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.124947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.125890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.126979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.127964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.128939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.129969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.130971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.131970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.132909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.133864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.134830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.135970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.136049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.136201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.136281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.136447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.136525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.136935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.137932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.138991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.139923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.140953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.141895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.142990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.143123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.143244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.143427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.143557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.143803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.143803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.144271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.144473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.144607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.144861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.145926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.146548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.146674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.146805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.146889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.147869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.148908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.149943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.150946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.151992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.152881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.153923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.154955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.155092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.155176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.155314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.155436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:21:41.155565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.155565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:21:41.155565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:21:41.185423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.185696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.185835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.185969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.186100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.186242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.194443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.194583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.226646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.226909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.226909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.227194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.368848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.369609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.419897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.420208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.420371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.420509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.486892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.487164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.487337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.487478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.487649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.487806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.487938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.488067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.488210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.488351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.488351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.488610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.514821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.515128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.515293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.515435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.515574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.515709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.515906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.516705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.527409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.527711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.540771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.540989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.541920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.542045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.542169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.542305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.542433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.542433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 09:21:41.559333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.559544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 09:21:41.559770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.559900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.560044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 09:21:41.560180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 09:21:41.560311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.560439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.560568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 09:21:41.560709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.560846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.560974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.561101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.561228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.561357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.561493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.572790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.573909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.581857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.582518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.585787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.586066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.586353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.586511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.586720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.586941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.587126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.587253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.587520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.587697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.587888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.588953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.589260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.589500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.616072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.617271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.617739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.618025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.618977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.619214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.623318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.623594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.623902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.624531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.624816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.625100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.631743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.632041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.632982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.633268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.636954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.637239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.637522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.637805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.638079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.638206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.638356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.638485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.638633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.638760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.638904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.639031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.639246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.639529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.640105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.657648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.657922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.658855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.659133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.663133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.664300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.666849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.667141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.667963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.668260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.672360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.673670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.676008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.677396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.679864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.680171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.680469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.680758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.681044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.681200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.681851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.681992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.681992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.682286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.682430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.682605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.700768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.701143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.701418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.701698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.702128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.702507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.702782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.703058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.709815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.711181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.711521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.711824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.712928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.713209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.714904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.715184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.715466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.715825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.716055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.716364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.716648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.716932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.717211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.717487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.730106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.730384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.730662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.730956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.731241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.731493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.731646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.731811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.731940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.732072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.732355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.732643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.732941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.733221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.751285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.752697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.754609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.756547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.758497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.759918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.760135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.761539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.762028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.762315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.762603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.763442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.763742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.764039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.770203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.771547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.771987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.773205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.775581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.775904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.776195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.776528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.776621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.776817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.777104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.777396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.786561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.787194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.787366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.787471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.787652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.787770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.795582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.795680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 09:21:41.795888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.795979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.796999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.797975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.798980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.799175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.799255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 09:21:41.838543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641c9fb89c0 pid: 80106 (default app) Jul 20 09:21:41.838686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641c9fb89c0 pid: 80105 (default app) Jul 20 09:21:41.842044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf0c8a-d904-4679-8e17-65ed2a1838cc None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:41.842344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf0c8a-d904-4679-8e17-65ed2a1838cc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:41.842630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf0c8a-d904-4679-8e17-65ed2a1838cc None None] PATH_INFO: `/v3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:41.846831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Jul 20 09:21:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:49.548139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.548705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.548705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.553094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:49.558293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:49.558733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:49.558860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:49.631738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: INFO dbcounter [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] Registered counter for database keystone Jul 20 09:21:49.654249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG oslo_db.sqlalchemy.engines [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:21:49.660601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writer thread running {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:21:49.838960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG passlib.handlers.bcrypt [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80106) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 09:21:49.839384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG passlib.handlers.bcrypt [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80106) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 09:21:49.893970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:49.895591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:50.022673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 09:21:50.093994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:50.165354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: INFO dbcounter [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] Registered counter for database keystone Jul 20 09:21:50.184743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG oslo_db.sqlalchemy.engines [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:21:50.190980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writer thread running {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:21:50.315633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33db404-4e3c-4366-a749-f1c5ce5f2022 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:50.320177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:50.320851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:50.321141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:50.321423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:50.329955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:50.382620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 09:21:50.382904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6858-7777-4740-ae1c-b566d6da7399 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:50.392994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Jul 20 09:21:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:21:50.399553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:50.414655 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e8c6d-27aa-4c86-a723-e3cf9c101795 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:50.419133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:50.420302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:50.420592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:50.420870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] PATH_INFO: `/v3/projects/6c023b716ed04429bdfefdcd2624fe52` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:50.424983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] RBAC: Authorizing `identity:get_project(project_id=6c023b716ed04429bdfefdcd2624fe52)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:50.476428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING keystone.common.rbac_enforcer.enforcer [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 09:21:50.476773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d6195-940a-4246-9789-1661c31c147d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:50.481413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Jul 20 09:21:50 2022] GET /identity/v3/projects/6c023b716ed04429bdfefdcd2624fe52 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:52.475300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba96c-553f-42db-8c7a-e355c7559359 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:52.475890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba96c-553f-42db-8c7a-e355c7559359 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:52.475890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba96c-553f-42db-8c7a-e355c7559359 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:52.480027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:21:52.486093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:52.486513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:52.486656 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:52.506494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:52.508059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:52.516281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 09:21:52.538168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba96c-553f-42db-8c7a-e355c7559359 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:52.550406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba96c-553f-42db-8c7a-e355c7559359 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:52.555105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786317e1-cdd0-4150-9b31-d90e04908643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:52.555757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786317e1-cdd0-4150-9b31-d90e04908643 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:52.556043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786317e1-cdd0-4150-9b31-d90e04908643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:52.556319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786317e1-cdd0-4150-9b31-d90e04908643 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:52.563946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786317e1-cdd0-4150-9b31-d90e04908643 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:52.565707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786317e1-cdd0-4150-9b31-d90e04908643 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:52.575041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Jul 20 09:21:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:21:52.580826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:52.590059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eff1f2-ced1-4e25-b10b-b67bd0275615 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:52.594527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bcd7d-fb70-48b5-b127-11a65689de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:52.595400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bcd7d-fb70-48b5-b127-11a65689de91 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:52.595681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bcd7d-fb70-48b5-b127-11a65689de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:52.595988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bcd7d-fb70-48b5-b127-11a65689de91 admin admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:52.597399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bcd7d-fb70-48b5-b127-11a65689de91 admin admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:52.599231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bcd7d-fb70-48b5-b127-11a65689de91 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:52.600836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Jul 20 09:21:52 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:54.677800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5afb7-8ac7-4519-ba75-6236a6a13653 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:54.678384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5afb7-8ac7-4519-ba75-6236a6a13653 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:54.678792 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5afb7-8ac7-4519-ba75-6236a6a13653 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:54.680679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:54.686253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:54.686691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:54.686845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:54.703594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:54.704838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:54.720096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317082-348d-4d40-92ba-30efb34a415a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:54.720390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317082-348d-4d40-92ba-30efb34a415a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:54.720673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317082-348d-4d40-92ba-30efb34a415a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:54.722590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:21:54.728428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:54.728722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:54.729006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:54.768638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG passlib.handlers.bcrypt [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80105) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 09:21:54.769056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG passlib.handlers.bcrypt [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80105) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 09:21:54.787888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:21:54.810846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:54.815458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:54.817115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:54.837016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:54.919071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:21:54.920666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe7db2-97e8-4d59-ac5c-ff4bba6ab62f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:54.941182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:54.955418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:54.956473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:54.956833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:54.957346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:54.972262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:21:54.984215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:21:54.985141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:21:54.986091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:21:54.991199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.057866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae9c81-0580-4575-b43f-546f78daa507 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.060192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.075575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.096331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.096549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f63c-830c-4a0b-9b9c-201e7fea5d5a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.097232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.097522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.097796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.131121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.131828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.132140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.132430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.133192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:55.133506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.134912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.147649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:55.153799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.166970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.168517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.253744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0334-2e5b-4ba2-b777-d41012cf5815 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.266391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:21:55.273305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.276117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.289155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.290038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.290319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.290594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.291831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.293305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.294935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:21:55 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:55.300257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.317858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.379595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c88f1-2797-4607-bff7-b189371cd4ee None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.404949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e956-12ed-4284-95a4-abd6dbdae9f2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.414870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.415669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.415977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.416251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.435707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.436996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.440310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.441117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.441402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.441679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.443470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.444980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.446594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:55.452356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:21:55.458542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:21:55.459472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:21:55.460324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:21:55.460324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:21:55.460324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:21:55.460324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:21:55.460324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:21:55.466287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:55.522995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.535085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:55.555316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d8cc-7968-409b-ba0b-3c2f69c34611 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.568126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62f15a-7108-4f2e-9a9e-246c1b2ab9cb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:55.589634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.590411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.590696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.590973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.591831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.domain.id=default, user.id=b23a970af9624514b8673afe5569bf18) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:55.592141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.593583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2a04f-cf1f-4840-a0aa-55bae2f419e2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.600949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Jul 20 09:21:55 2022] GET /identity/v3/role_assignments?user.id=b23a970af9624514b8673afe5569bf18&scope.domain.id=default&role.id=2e997984fe364ad8afd717716e701a23 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:55.602896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:55.603573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:55.603885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:55.604234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:55.604904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:55.605215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:55.606639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471db8e-14f5-4438-9ee7-2e3abaf4f4cd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:55.627069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:21:57.785850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e84f3-b595-463e-9c3a-5a0555b44549 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.786940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e84f3-b595-463e-9c3a-5a0555b44549 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.787424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e84f3-b595-463e-9c3a-5a0555b44549 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.789376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:57.794717 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bb108-5741-4632-aa15-1f9d5112518a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:57.795535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bb108-5741-4632-aa15-1f9d5112518a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:57.796030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bb108-5741-4632-aa15-1f9d5112518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:57.819574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-867bb108-5741-4632-aa15-1f9d5112518a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:57.821372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-867bb108-5741-4632-aa15-1f9d5112518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:57.906742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:21:57.945022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e84f3-b595-463e-9c3a-5a0555b44549 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.065396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e84f3-b595-463e-9c3a-5a0555b44549 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.110983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621348e8-dfc8-458c-a7e9-8c0acb8bd6ad None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.111293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621348e8-dfc8-458c-a7e9-8c0acb8bd6ad None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.111543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621348e8-dfc8-458c-a7e9-8c0acb8bd6ad None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.112938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:21:58.118326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.118631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.118911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.123130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.123962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.124253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.124537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.148129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.150553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.160561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:21:58.169167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:21:58.170036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:21:58.171236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 13/25] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:21:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:21:58.180773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.191913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.242568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.298172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:21:58.356301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.405827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9417-ea79-401c-8417-101b214e9e74 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.477394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.478067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.478352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.478629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.479404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:58.479728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.481190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04532f-6edc-4157-969e-d2d3e40d3432 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.494722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:58.496072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885a902-bb23-4c00-8c1e-ff013f698855 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.496362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885a902-bb23-4c00-8c1e-ff013f698855 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.496641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885a902-bb23-4c00-8c1e-ff013f698855 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.499109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 15/28] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:58.506474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885a902-bb23-4c00-8c1e-ff013f698855 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.570439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c6a51-e789-4ca1-86f3-43c9f7589478 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.624260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.646540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.648178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.649458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.650013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.651650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.653516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.689308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885a902-bb23-4c00-8c1e-ff013f698855 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:58.745972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f2403-fff5-450d-bec3-2e3203d80d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:58.746950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2403-fff5-450d-bec3-2e3203d80d1f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.747228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2403-fff5-450d-bec3-2e3203d80d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.747502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2403-fff5-450d-bec3-2e3203d80d1f None admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.748848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f2403-fff5-450d-bec3-2e3203d80d1f None admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:58.750326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f2403-fff5-450d-bec3-2e3203d80d1f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:58.752018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 16/29] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:21:58 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:58.753200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98103-a6ab-485b-b37d-4aabcc01cefd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.753483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98103-a6ab-485b-b37d-4aabcc01cefd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.753758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf98103-a6ab-485b-b37d-4aabcc01cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.777452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9cf98103-a6ab-485b-b37d-4aabcc01cefd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.778651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9cf98103-a6ab-485b-b37d-4aabcc01cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:58.852912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 14/30] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/roles => generated 219 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:58.855756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:58.913567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:21:58.915816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59618b-a082-45bf-a6a9-078fe5f17814 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.916311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59618b-a082-45bf-a6a9-078fe5f17814 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.916790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59618b-a082-45bf-a6a9-078fe5f17814 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.918574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 18/32] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:58.928590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:58.937832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:58.938556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:58.939084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:58.958488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:58.959770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:59.032165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.036399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:21:59.037266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.064212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcf35b-bec5-4f06-a66f-d3b9f8698486 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.136247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.137767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.138462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.138996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.144736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.148162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.150323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 15/34] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:59.152051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.181279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba823a-4db5-46e5-adba-1ab21245f482 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.234925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.236637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.237154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.237633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.250989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.254487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:21:59.278350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:21:59.279223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:21:59.280848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:21:59.280848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:21:59.280848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:21:59.280848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:21:59.287903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 20/35] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:21:59.287903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.304831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b37b8-d736-41a1-b6bb-19a9eb321df9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.307159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.348264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.348996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.349288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.349567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.350325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.350940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.351846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.367555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 16/36] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/roles => generated 225 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:21:59.368208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.430837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a215a-b9fc-4bff-b5d7-b65477615e13 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.477081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.478351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.478838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.479340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] PATH_INFO: `/v3/domains/default/users/b23a970af9624514b8673afe5569bf18/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.481836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b23a970af9624514b8673afe5569bf18, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.483639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.517754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b75a-071e-400f-95dc-979e4dc1a105 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.558550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.559282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.559618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.559924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.560667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:21:59.560978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.562379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11621a-3b03-4889-ae3c-9662f2af8a05 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.576167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 17/37] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:21:59.577451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cdd7-80f5-40e2-9c59-1ddaecd1bdbb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.577747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cdd7-80f5-40e2-9c59-1ddaecd1bdbb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.578028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cdd7-80f5-40e2-9c59-1ddaecd1bdbb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.579307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 18/38] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:59.587266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.587628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.587942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.617652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:21:59.620031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:21:59.640414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Jul 20 09:21:59 2022] PUT /identity/v3/domains/default/users/b23a970af9624514b8673afe5569bf18/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:21:59.642536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.654460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.746117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:21:59.777180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:21:59.818756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debad4a-33a9-469c-8ddd-2e5fa4ea6269 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.829794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:59.865121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.865808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.866120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.866407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.867232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.869278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.901046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292a0c-784b-46da-a268-3dd2ccf71147 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:21:59.944494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a123e-b6c6-4d7f-8397-5c69cc069686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:21:59.945573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a123e-b6c6-4d7f-8397-5c69cc069686 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.946089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a123e-b6c6-4d7f-8397-5c69cc069686 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.946571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a123e-b6c6-4d7f-8397-5c69cc069686 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.947575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a123e-b6c6-4d7f-8397-5c69cc069686 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:21:59.949288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a123e-b6c6-4d7f-8397-5c69cc069686 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:21:59.965405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:21:59.967240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35800-51cc-4339-b93e-c8d83e8b9a2c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.967794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35800-51cc-4339-b93e-c8d83e8b9a2c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.968288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35800-51cc-4339-b93e-c8d83e8b9a2c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.970332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 21/42] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:21:59.978371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:21:59.979039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:21:59.979531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:21:59.999382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:00.001241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:00.013992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:00.022125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:00.096078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:00.121598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:00.256507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9462fbd-3150-4c5b-a1ec-c9065a423946 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:00.296179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b7e77-0c9a-4914-aa4a-67ab0e5a6e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:00.296991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7e77-0c9a-4914-aa4a-67ab0e5a6e18 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:00.297277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7e77-0c9a-4914-aa4a-67ab0e5a6e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:00.297554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7e77-0c9a-4914-aa4a-67ab0e5a6e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:00.298739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7e77-0c9a-4914-aa4a-67ab0e5a6e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:00.300254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7e77-0c9a-4914-aa4a-67ab0e5a6e18 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:00.301904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:00.308257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:00.409066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86e1aa-bc1b-419e-977d-d6f326374667 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:00.445200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb1db-f0f7-4d6f-a58a-fb6125a9aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:00.445871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb1db-f0f7-4d6f-a58a-fb6125a9aefe None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:00.446159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb1db-f0f7-4d6f-a58a-fb6125a9aefe None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:00.446439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb1db-f0f7-4d6f-a58a-fb6125a9aefe None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:00.447170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb1db-f0f7-4d6f-a58a-fb6125a9aefe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:00.448671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb1db-f0f7-4d6f-a58a-fb6125a9aefe None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:00.464922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:00.487749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:22:00 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:01.799157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13efe-c6de-410a-b0f9-8433a2ea8a7e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.799677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13efe-c6de-410a-b0f9-8433a2ea8a7e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.799861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13efe-c6de-410a-b0f9-8433a2ea8a7e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.801288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:01.806570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:01.806995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:01.807136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:01.824883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:01.826684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:01.896962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:01.919742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13efe-c6de-410a-b0f9-8433a2ea8a7e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:01.949063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.024093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13efe-c6de-410a-b0f9-8433a2ea8a7e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.057650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.058376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.058684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.058940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.069682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:02.077330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:02.078205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:02.079135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:02.084441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.287070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddafbd2-7a71-4e45-bab2-ee3eac8460e9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.312025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.320930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.321601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.321884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.322156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.322909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:02.323215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.324605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.336604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:02.342366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.440996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.457958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d2925-c5fb-41d6-b15e-e30a6edb5d2c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.491528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d99c9a-630a-472f-9408-1c509474201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.492442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d99c9a-630a-472f-9408-1c509474201b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.492735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d99c9a-630a-472f-9408-1c509474201b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.493079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d99c9a-630a-472f-9408-1c509474201b None admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.494240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d99c9a-630a-472f-9408-1c509474201b None admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.495708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d99c9a-630a-472f-9408-1c509474201b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.497389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:02 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:02.502816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.526200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a86b-c09a-449c-a7f0-f60418f85e89 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.526488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a86b-c09a-449c-a7f0-f60418f85e89 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.526772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a86b-c09a-449c-a7f0-f60418f85e89 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.528175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 27/52] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:02.533128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.533424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.533707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.550287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:02.551856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:02.606154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3e1ae-064c-4e9a-8cc7-7c8c9b2102eb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.620739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:02.642510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.643314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.643604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.643922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.644531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.645110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.647154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.648872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:02.655873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.718270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.751182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.768661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9eed3-2867-46be-8e24-cb9e0420f785 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.773377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e660c-45ab-44a3-b1a8-8aa87ee83cd2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.804444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.805294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.805580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.805856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.807071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.808559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.810203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:02.811134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.811841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.812136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.812481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.813357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.domain.id=default, user.id=b23a970af9624514b8673afe5569bf18) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:02.813678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.815137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d0041-5568-4a6b-bb8a-0fbda8023553 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.818283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:02.825782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Jul 20 09:22:02 2022] GET /identity/v3/role_assignments?user.id=b23a970af9624514b8673afe5569bf18&scope.domain.id=default&role.id=2e997984fe364ad8afd717716e701a23 => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:02.926423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe4fd2-af8a-49c5-b8b4-e0238507b371 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:02.963030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd324-d287-4eef-88d8-490f22e4d220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:02.963753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd324-d287-4eef-88d8-490f22e4d220 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:02.964030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd324-d287-4eef-88d8-490f22e4d220 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:02.964305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd324-d287-4eef-88d8-490f22e4d220 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:02.965026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bd324-d287-4eef-88d8-490f22e4d220 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:02.966499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bd324-d287-4eef-88d8-490f22e4d220 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:02.995838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Jul 20 09:22:02 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:22:05.047208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d206-9a77-4788-8c17-2a3b66359ffe None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:05.047764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d206-9a77-4788-8c17-2a3b66359ffe None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:05.047879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d206-9a77-4788-8c17-2a3b66359ffe None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:05.049207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:05.055911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:05.056368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:05.056482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:05.062493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:05.074442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:05.075635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:05.141908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:05.168477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d206-9a77-4788-8c17-2a3b66359ffe None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:05.268700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d206-9a77-4788-8c17-2a3b66359ffe None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:05.288976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:05.303031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141be9-6287-4ff9-a207-bb827fcc8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:05.303862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141be9-6287-4ff9-a207-bb827fcc8529 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:05.304155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141be9-6287-4ff9-a207-bb827fcc8529 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:05.304438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141be9-6287-4ff9-a207-bb827fcc8529 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:05.305632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55141be9-6287-4ff9-a207-bb827fcc8529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:05.307286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55141be9-6287-4ff9-a207-bb827fcc8529 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:05.308761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:05.314264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:05.410775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dd2be-bc55-4e06-8491-6f1091390247 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:05.449173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbced336-3760-4a50-84dd-d203c20c87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:05.449852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced336-3760-4a50-84dd-d203c20c87d8 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:05.450136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced336-3760-4a50-84dd-d203c20c87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:05.450415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced336-3760-4a50-84dd-d203c20c87d8 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:05.451136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbced336-3760-4a50-84dd-d203c20c87d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:05.452628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbced336-3760-4a50-84dd-d203c20c87d8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:05.461692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:05.488821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:05 2022] POST /identity/v3/users => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:08.677861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb235b7-4b8f-4f7f-a5b3-5a2988cad881 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:08.678792 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb235b7-4b8f-4f7f-a5b3-5a2988cad881 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:08.679243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb235b7-4b8f-4f7f-a5b3-5a2988cad881 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:08.680816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:08.686229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d145e1-f0b6-44fc-94f8-9cc1c894a9cb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:08.687016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d145e1-f0b6-44fc-94f8-9cc1c894a9cb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:08.687489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d145e1-f0b6-44fc-94f8-9cc1c894a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:08.712781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b3d145e1-f0b6-44fc-94f8-9cc1c894a9cb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:08.714272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b3d145e1-f0b6-44fc-94f8-9cc1c894a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:08.798995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c7e4-ad2a-4131-8f7a-a89d4cbde52e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:08.799601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c7e4-ad2a-4131-8f7a-a89d4cbde52e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:08.800605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c7e4-ad2a-4131-8f7a-a89d4cbde52e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:08.802945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:08.809410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4994b-e95a-4c25-981f-47b2e9ddd01e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:08.809951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4994b-e95a-4c25-981f-47b2e9ddd01e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:08.810305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4994b-e95a-4c25-981f-47b2e9ddd01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:08.815658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 33/64] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:08.835740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842d819-c60c-4b19-bb23-682ef533f4aa None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:08.835740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842d819-c60c-4b19-bb23-682ef533f4aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:08.835740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842d819-c60c-4b19-bb23-682ef533f4aa None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:08.835740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 34/65] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:08.841001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842d819-c60c-4b19-bb23-682ef533f4aa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:08.851103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d4f4994b-e95a-4c25-981f-47b2e9ddd01e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:08.852378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d4f4994b-e95a-4c25-981f-47b2e9ddd01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:08.931789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:08.933032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:08.933330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:08.933614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:08.961143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:08.962356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:08.971227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842d819-c60c-4b19-bb23-682ef533f4aa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:08.993762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.009622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.010536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.010899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.011331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.023922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:09.032293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:09.033134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:09.033869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 35/67] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:09.034982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.043657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:09.044411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.122296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.149888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d29f1-e4d8-409e-91ee-0c2af8c833e7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.189646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885baf7f-3176-4ab1-aa93-4b1460ad2fa2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.189938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.190740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.191139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.191425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.203209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:09.211665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:09.212557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:09.213305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 36/69] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:09.213922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.229871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.230664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.231028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.231392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.232286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:09.232677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.234081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76777-4b80-423e-bac9-dc7d9bae1340 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.243035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 34/70] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:09.245803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432b91f-4beb-45e0-9131-85f78363048a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.246254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432b91f-4beb-45e0-9131-85f78363048a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.246955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432b91f-4beb-45e0-9131-85f78363048a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.248658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 35/71] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:09.252661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432b91f-4beb-45e0-9131-85f78363048a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.265443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.326503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786fc68-8201-4acd-952f-2557fe895a06 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.357000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432b91f-4beb-45e0-9131-85f78363048a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.360340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.361147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.361439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.361722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.367578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.372336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:09.380640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:09.381515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:09.382270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:09.382877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.394296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.394977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.395265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.395612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.396911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:09.397282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.398679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afdf03-16ab-4f14-8571-411bb27c7377 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.406634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:09.407853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5394-786a-45b0-a393-56de7055e1a7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.408146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5394-786a-45b0-a393-56de7055e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.408428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5394-786a-45b0-a393-56de7055e1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.425811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c22c5394-786a-45b0-a393-56de7055e1a7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:09.427020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c22c5394-786a-45b0-a393-56de7055e1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:09.484893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.488556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1413fe-7b50-4734-80b6-0b321b8aaac6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.500074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 37/74] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:09.501466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89cfd-6411-4d55-94a5-1db549208cde None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.501853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89cfd-6411-4d55-94a5-1db549208cde None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.502049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89cfd-6411-4d55-94a5-1db549208cde None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.503335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 38/75] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:09.504071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc89cfd-6411-4d55-94a5-1db549208cde None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.539247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.540212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.540524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.540804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.554575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.556091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.557970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:09.558539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.604604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc89cfd-6411-4d55-94a5-1db549208cde None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.606111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.640425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.641112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.641403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.641686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.642475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:09.642791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.644249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f79c-be4d-4528-aa4a-457eadb9a64d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.652766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:09.653948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.654240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.654525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.664022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909db06-4356-4329-bd54-3a032383da3e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.671290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:09.672537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:09.697755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.698741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.699029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.699308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.700566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.702024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.709029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:09.709029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.734727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.744015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:09.744810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.821639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9f8d-1c1e-49b2-9a6a-b24915116873 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.846388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.853742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea5502-9992-417c-9bb7-d1750d876a99 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:09.858992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.859837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.860133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.860420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.862021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.863501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.865411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:09.866062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:09.892595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:09.893257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:09.893544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:09.893834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:09.961472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:09.962591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:09.962946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:09.969647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937887-5863-4361-bfca-75b3e416188b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.003221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.004065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.004351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.004631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.006335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.007848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.009495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:10.014408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.058633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.066553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:10.067928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.111750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8968-a135-4d4d-9a7a-91edbb984078 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.147035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.147700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.148044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.148370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.168030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b743712-2c06-402c-af0f-c61746ae16a8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.178852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.202788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.203589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.203909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.204193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.215892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:10.217548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.219018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:10.225506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:10.226351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:10.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:10.227704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.283253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.324416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:10.329322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.329689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521ef8-6c13-4bd9-9aa9-8e4dfaae89e3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.362384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.363067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.363358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.363640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.364914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.366377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.385243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.402398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 43/85] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:10 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:10.402398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.429514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4a0a-15cd-4200-8078-6efedbf09684 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.475735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.476440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.476735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.477020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.511876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200e30f-e2a9-4576-a36f-fbe7160cb3a7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.527784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.558183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.558994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.560196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.560196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.560898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.562370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.564361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:10.564905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.582651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.584764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.664738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.690811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d2fb4-bc99-4b63-a154-9cd1e48a7c5d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.718562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:10.718562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.736172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.737307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.737764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.738147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.739165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:10.739165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.740704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.751831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 45/88] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:10.752669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.810300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.841564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad46793-a276-41d3-9445-0fa8f57a6094 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.880995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.882398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.883064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.883487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.884976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.886605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.889584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:10.890754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:10.899362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942219c7-6654-48e2-b43c-d57d992e888c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:10.931655 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:10.945903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:10.946574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:10.947378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:10.947675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:10.948573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=4be60a1b42104c2fb599167b6e30dc37) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:10.948891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:10.950770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:10.959150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/role_assignments?user.id=4be60a1b42104c2fb599167b6e30dc37&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=30419c28dd3c4881a47b462c6717a79e => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:10.959833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:11.055039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b955964-b74f-4dac-987e-6d5999311457 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:11.109734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959dbbf-19c1-4d77-9ce5-6d8fac11f4b6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:11.112296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:11.144810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:11.146735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:11.147369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:11.147929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:11.151824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:11.153853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:11.156084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:11.157065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:11.162396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:11.162396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:11.162396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:11.162396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:11.162729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:11.162729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:11.164253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:10 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:11.165030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:11.268555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fe8e6-defe-4177-a98b-5cb7127b9aca None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:11.289928 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:11.300145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f2279-42f9-4f47-b853-da5089a43d8f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:11.304519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:11.305199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:11.305501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:11.305775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:11.309956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=b23a970af9624514b8673afe5569bf18) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:11.309956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:11.309956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:11.314129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:11 2022] GET /identity/v3/role_assignments?user.id=b23a970af9624514b8673afe5569bf18&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:11.314949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:11.352331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:11.384809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:11.385886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:11.386366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:11.386965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:11.388396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] RBAC: Adding query filter params (role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=4be60a1b42104c2fb599167b6e30dc37) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:11.388925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:11.390591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:11.403993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 46/94] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:11 2022] GET /identity/v3/role_assignments?user.id=4be60a1b42104c2fb599167b6e30dc37&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:11.427670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab51b-2bb7-4006-a9ed-b667b93ef7ac None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:11.469820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:11.470515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:11.470807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:11.471092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:11.563170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:11.564718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:11.604087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:11.678149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 49/95] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:11.683747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:11.798698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a85db-88df-45a5-8597-2d3018c47359 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:11.839921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e45d9-a167-4ba9-bef3-a163f542fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:11.840812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e45d9-a167-4ba9-bef3-a163f542fe1d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:11.841104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e45d9-a167-4ba9-bef3-a163f542fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:11.841439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e45d9-a167-4ba9-bef3-a163f542fe1d None admin] PATH_INFO: `/v3/projects/4e64111b4a76410baba309d689d49731` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:11.843136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e45d9-a167-4ba9-bef3-a163f542fe1d None admin] RBAC: Authorizing `identity:get_project(project_id=4e64111b4a76410baba309d689d49731)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:11.844646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e45d9-a167-4ba9-bef3-a163f542fe1d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:11.846662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:11 2022] GET /identity/v3/projects/4e64111b4a76410baba309d689d49731 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:11.852524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:11.969632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cfefe-e33e-4c74-81df-a8fa80893664 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:12.009003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:12.009690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:12.009981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:12.010263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:12.011123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=4e64111b4a76410baba309d689d49731, user.id=4be60a1b42104c2fb599167b6e30dc37) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:12.011443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:12.013325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed9946-e3ac-4038-9208-b5f4e21db507 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:12.016464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:12.023254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:11 2022] GET /identity/v3/role_assignments?user.id=4be60a1b42104c2fb599167b6e30dc37&scope.project.id=4e64111b4a76410baba309d689d49731&role.id=30419c28dd3c4881a47b462c6717a79e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:13.319686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995589-7498-4c34-9c42-79f139c4bc6e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:13.320215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995589-7498-4c34-9c42-79f139c4bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:13.320290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995589-7498-4c34-9c42-79f139c4bc6e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:13.321668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 48/98] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:13.326994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:13.327500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:13.327654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:13.350137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:13.351394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:13.361270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdf77-833d-406e-9473-8f660c277195 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:13.361561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdf77-833d-406e-9473-8f660c277195 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:13.361829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdf77-833d-406e-9473-8f660c277195 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:13.363227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 49/99] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:13.368450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:13.368744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:13.369030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:13.389011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:13.390978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:13.420191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:13.454373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:13.501213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:13.529338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:13.583563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:13.769243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7685-2748-4fec-bb2e-d2e0c4217c3f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:13.794680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c38c83-cd9a-4957-950a-124ce140c09c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:13.840555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:13.841729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:13.842260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:13.842735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:13.860085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:13.872907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:13.885228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:13.886064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:13.886352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:13.886635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:13.888166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:13.889655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:13.891315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:13.897355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:13.897827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:13.898638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:13.899361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:13.902469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 51/103] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:13.914713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:13.964097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:14.148340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87724-b8aa-4127-a836-ce9ef57c9b72 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:14.169955 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7d99-7133-4748-b624-dba69a2c2d1b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:14.214185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8423d79-e502-4d98-83e6-dfc3669b74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:14.214868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423d79-e502-4d98-83e6-dfc3669b74c3 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.215161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423d79-e502-4d98-83e6-dfc3669b74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.215434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8423d79-e502-4d98-83e6-dfc3669b74c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.216687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423d79-e502-4d98-83e6-dfc3669b74c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:14.218155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8423d79-e502-4d98-83e6-dfc3669b74c3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:14.256165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:14.258070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.258907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.259382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.260714 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:14.262703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:14.263275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 53/104] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:22:13 2022] POST /identity/v3/projects => generated 302 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:22:14.265233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:14.266860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4612-5164-491d-9be2-82fb247b1711 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.268073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4612-5164-491d-9be2-82fb247b1711 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.268558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4612-5164-491d-9be2-82fb247b1711 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.271216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 54/105] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:14.278504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac25cda-0a07-429c-bb5e-2ab3603cd698 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.282145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac25cda-0a07-429c-bb5e-2ab3603cd698 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.282760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac25cda-0a07-429c-bb5e-2ab3603cd698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.290184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:14.297006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:14.316758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9ac25cda-0a07-429c-bb5e-2ab3603cd698 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:14.320882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9ac25cda-0a07-429c-bb5e-2ab3603cd698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:14.417067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:14.464083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:14.467408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 55/107] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:14.468843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad814e61-f243-4298-b9f3-80a0567f03a1 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.469133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad814e61-f243-4298-b9f3-80a0567f03a1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.469414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad814e61-f243-4298-b9f3-80a0567f03a1 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.470791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 56/108] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:14.481259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.481772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.482200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.488096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990fb6d-13da-421c-b7a0-67494a5382b7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:14.527734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:14.528953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:14.533266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:14.534161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.534509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.534789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] PATH_INFO: `/v3/users/9c84dd4d277646869e0214038b83e040` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.550319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c84dd4d277646869e0214038b83e040)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:14.552632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:14.555348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 53/109] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:14 2022] GET /identity/v3/users/9c84dd4d277646869e0214038b83e040 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:14.556364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:14.618878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 57/110] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:14.620175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:14.686442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216dd3-4ae5-4033-9f5f-995289b7b7c7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:14.722022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b309b86-a7a8-43d2-8bf0-5f2de59fcde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:14.723080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b309b86-a7a8-43d2-8bf0-5f2de59fcde9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.724188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b309b86-a7a8-43d2-8bf0-5f2de59fcde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.724650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b309b86-a7a8-43d2-8bf0-5f2de59fcde9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.735939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b309b86-a7a8-43d2-8bf0-5f2de59fcde9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:14.742780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7b309b86-a7a8-43d2-8bf0-5f2de59fcde9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:14.749222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:14.750072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:14.750808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:14.751375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20087f26-17eb-4453-b498-d0bd5f09b55c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:14.753884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 54/111] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:14.755897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada5ec-3d92-4a02-b608-b27f1fd9d893 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.756373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada5ec-3d92-4a02-b608-b27f1fd9d893 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.756847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada5ec-3d92-4a02-b608-b27f1fd9d893 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.758355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 55/112] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:14.759305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada5ec-3d92-4a02-b608-b27f1fd9d893 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:14.765246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:14.796750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ddca2-4c9b-4d8d-8851-4a1b492a52db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:14.797427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ddca2-4c9b-4d8d-8851-4a1b492a52db None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.797718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ddca2-4c9b-4d8d-8851-4a1b492a52db None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.798035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ddca2-4c9b-4d8d-8851-4a1b492a52db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.899119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ddca2-4c9b-4d8d-8851-4a1b492a52db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:14.901306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ddca2-4c9b-4d8d-8851-4a1b492a52db None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:14.908952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada5ec-3d92-4a02-b608-b27f1fd9d893 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:14.961574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:14.963475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:14.963994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:14.964467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:14.979918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:14.991347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:14.992209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:14.992948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:14.995385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 56/113] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:14.996839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.024221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 58/114] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:15.025751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.026255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.026846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.044479 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:15.045955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:15.050253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.075785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.132367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683336-3985-49d7-8920-a55ef89e89c6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.135577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:15.136659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.175077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.175783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.176238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.176512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.177897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:15.178207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.179592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.188133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.193436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.253948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1217c-9392-44e8-b0ff-4b64470164e4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.290732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.291404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.291688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.291997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.292744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:15.293053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.294429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b64054-c7f5-4024-9044-73810dc43610 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.295122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d0a8-aeaf-4a48-b94d-80fed8987718 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.302951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 60/117] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.309395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2acb4-f56d-4b08-9c66-5482d2229bc8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.309395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2acb4-f56d-4b08-9c66-5482d2229bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.309395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2acb4-f56d-4b08-9c66-5482d2229bc8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.309395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 61/118] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:15.309395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2acb4-f56d-4b08-9c66-5482d2229bc8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.310027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.326099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.338441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.339322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.339612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.339918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.341115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.342577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.349512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 58/119] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.349512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.428088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2acb4-f56d-4b08-9c66-5482d2229bc8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.456580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343d182-7fe6-4260-8baa-7c7585e9146f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.465731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.466537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.466822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.467100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.479208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:15.486945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:15.487831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:15.488580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 62/120] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:15.494185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.501711 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f798cf0-eb56-42f7-96ce-e9e33956a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.502604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f798cf0-eb56-42f7-96ce-e9e33956a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.502890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f798cf0-eb56-42f7-96ce-e9e33956a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.503177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f798cf0-eb56-42f7-96ce-e9e33956a1e1 None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.504926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f798cf0-eb56-42f7-96ce-e9e33956a1e1 None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.506346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f798cf0-eb56-42f7-96ce-e9e33956a1e1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.508022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 59/121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.513893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.514302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.514486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.532581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:15.533790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:15.559061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.595673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.605707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac53f16-f8ef-4ba6-9e22-2aef740f93f7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.615764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 60/122] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:15.615764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.656905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.658692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.659128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.659552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.662413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.664095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.665901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.667244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.731136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3384cc-bbb1-4faf-96f7-7dec8fbc2742 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.768265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.768853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.769138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.769415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.770249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] RBAC: Adding query filter params (role.id=bb69314e349248aa8762ba2dfc9f71ea, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=9c84dd4d277646869e0214038b83e040) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:15.771097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.772558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.773194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cef6e-8478-4ca9-8d3c-fe79ed63cf5b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.787754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/role_assignments?user.id=9c84dd4d277646869e0214038b83e040&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=bb69314e349248aa8762ba2dfc9f71ea => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.787754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.816503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.826682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.826682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.828582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:15.828874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:15.829670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:15.830003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:15.831543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:15.841702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:15.842440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:15.870641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:15.947013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a94685-9cb0-4296-9b25-ed5e1433b91e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.968076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b823b35-8be6-498e-9796-c893c85b8ccc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:15.996851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:15.998373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:15.999135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.000012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.001825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.003669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.004661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.006090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.006597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.006987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:16.007943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.011671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.023672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:16.031578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:16.032528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:16.033321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:16.034669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.109601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:16.143338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239bd9-2e03-4d21-bbf0-5ecaa8dde780 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.162778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63c553-afaa-43f0-adff-719368a9ef84 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.176397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:16.206585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.207615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.208075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.208470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.209793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.211238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.211416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.212447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.212902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.213336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.213895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 66/128] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:16 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:16.214849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.215015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.216753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.218752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 63/129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:16 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:16.219757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.324125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32803848-1488-4834-bd3f-4b60f256706a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.327089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a4c8b-be55-4cb7-81d5-e9b2092b06c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.356110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:16.361998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.362903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.363192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.363470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004/users/4be60a1b42104c2fb599167b6e30dc37/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.366265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] RBAC: Authorizing `identity:create_grant(project_id=16f5cac40dc546bd88833a590e407004, user_id=4be60a1b42104c2fb599167b6e30dc37, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.367685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.367852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.368722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.369219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.369703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.370831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:16.371347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.374040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.384991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 67/130] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:16 2022] PUT /identity/v3/projects/16f5cac40dc546bd88833a590e407004/users/4be60a1b42104c2fb599167b6e30dc37/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:16.386189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.387863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 64/131] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:16.389031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.510682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:16.560840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97abd5-2836-4795-9f0b-8cf890e44619 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.603999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892fcb8-53c4-473d-b91e-4aa0e3828865 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.606928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.608166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.608680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.609160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.610701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.612666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.615436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:16 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:16.616557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.647880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b679e8-ff51-4dea-a8bc-fab3292fdea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.648784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b679e8-ff51-4dea-a8bc-fab3292fdea0 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.649075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b679e8-ff51-4dea-a8bc-fab3292fdea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.649360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b679e8-ff51-4dea-a8bc-fab3292fdea0 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004/users/4be60a1b42104c2fb599167b6e30dc37/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.652861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b679e8-ff51-4dea-a8bc-fab3292fdea0 None admin] RBAC: Authorizing `identity:create_grant(project_id=16f5cac40dc546bd88833a590e407004, user_id=4be60a1b42104c2fb599167b6e30dc37, role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.654389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b679e8-ff51-4dea-a8bc-fab3292fdea0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.671585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:16 2022] PUT /identity/v3/projects/16f5cac40dc546bd88833a590e407004/users/4be60a1b42104c2fb599167b6e30dc37/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:16.672948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539e71-cc8b-421a-81fa-a24beee9dc7b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.673266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539e71-cc8b-421a-81fa-a24beee9dc7b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.673664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539e71-cc8b-421a-81fa-a24beee9dc7b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.674976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 66/134] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:16.680094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539e71-cc8b-421a-81fa-a24beee9dc7b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.682826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:16.747794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3897608-d0f3-49dd-9b64-f6ec1f1660c9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.801261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ee69-cc60-46a6-8067-606478a4a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.802670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ee69-cc60-46a6-8067-606478a4a5ed None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.803201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ee69-cc60-46a6-8067-606478a4a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.803487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ee69-cc60-46a6-8067-606478a4a5ed None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.804379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539e71-cc8b-421a-81fa-a24beee9dc7b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:16.806386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ee69-cc60-46a6-8067-606478a4a5ed None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.808184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ee69-cc60-46a6-8067-606478a4a5ed None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.809722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 69/135] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:16 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:16.810930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.811222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.811513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.818406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:16.846496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:16.848003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:16.848528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:16.849022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004/users/b23a970af9624514b8673afe5569bf18/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:16.851387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] RBAC: Authorizing `identity:create_grant(project_id=16f5cac40dc546bd88833a590e407004, user_id=b23a970af9624514b8673afe5569bf18, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:16.852922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:16.853418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:16.854316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:16.882933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:16 2022] PUT /identity/v3/projects/16f5cac40dc546bd88833a590e407004/users/b23a970af9624514b8673afe5569bf18/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:16.884171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:16.995676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:17.039961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:17.072318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7663813-24c0-461b-848d-015dc5d1068c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:17.116211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:17.117047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:17.117339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:17.117624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] PATH_INFO: `/v3/projects/4e64111b4a76410baba309d689d49731` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:17.120656 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] RBAC: Authorizing `identity:get_project(project_id=4e64111b4a76410baba309d689d49731)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:17.122182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:17.128549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 68/138] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:16 2022] GET /identity/v3/projects/4e64111b4a76410baba309d689d49731 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:17.134461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:17.141083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:17.194149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:17.224751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bc410-f135-436e-b66c-b8b10f989387 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:17.265465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8bff-de4d-492d-8ac7-30de539ca94d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:17.275533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:17.277192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:17.277858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:17.278486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:17.284935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:17.286517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:17.288822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 71/139] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:17.296716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:17.312522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6161f-96cc-437c-817a-95d5b7340f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:17.313790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6161f-96cc-437c-817a-95d5b7340f58 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:17.314281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6161f-96cc-437c-817a-95d5b7340f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:17.314789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6161f-96cc-437c-817a-95d5b7340f58 None admin] PATH_INFO: `/v3/projects/4e64111b4a76410baba309d689d49731/users/4be60a1b42104c2fb599167b6e30dc37/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:17.317840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6161f-96cc-437c-817a-95d5b7340f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e64111b4a76410baba309d689d49731, user_id=4be60a1b42104c2fb599167b6e30dc37, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:17.319602 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6161f-96cc-437c-817a-95d5b7340f58 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:17.338840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 69/140] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:17 2022] PUT /identity/v3/projects/4e64111b4a76410baba309d689d49731/users/4be60a1b42104c2fb599167b6e30dc37/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:17.470521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef44c7-11c4-40c6-9520-d8084aad7bc0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:17.493001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:17.519176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd421c17-a9a3-463b-bdcd-79067a976d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:17.519901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd421c17-a9a3-463b-bdcd-79067a976d80 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:17.520198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd421c17-a9a3-463b-bdcd-79067a976d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:17.520544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd421c17-a9a3-463b-bdcd-79067a976d80 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:17.521270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd421c17-a9a3-463b-bdcd-79067a976d80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:17.522718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd421c17-a9a3-463b-bdcd-79067a976d80 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:17.555209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 72/141] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:17 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:18.275253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599af3b7-56b1-4d04-a0bc-ece37409f1da None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:18.275857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599af3b7-56b1-4d04-a0bc-ece37409f1da None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:18.275857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599af3b7-56b1-4d04-a0bc-ece37409f1da None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:18.277404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 70/142] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:18.283156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:18.283764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:18.283764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:18.308752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:18.309987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:18.393041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:18.431604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599af3b7-56b1-4d04-a0bc-ece37409f1da None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:18.551541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:18.556863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599af3b7-56b1-4d04-a0bc-ece37409f1da None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:18.603602 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:18.604426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:18.604702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:18.604981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:18.619091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:18.626985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:18.627903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:18.628626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:18.635955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:18.772463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:18.778622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd778b-3ad1-4593-a3ce-2ad39e9709a9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:18.820144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:18.820735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:18.821034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:18.821315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:18.822094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:18.822406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:18.826369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:18.837402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 74/145] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:18.844819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:19.008570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eadeb8-f6db-454f-a9fc-1a87a53e8be5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:19.110237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:19.111069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:19.111359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:19.111643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] PATH_INFO: `/v3/users/9c84dd4d277646869e0214038b83e040` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:19.116489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=9c84dd4d277646869e0214038b83e040)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:19.117982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:19.120051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 72/146] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:18 2022] GET /identity/v3/users/9c84dd4d277646869e0214038b83e040 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:19.126481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:19.276863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c027815-62b1-4f1b-a7bb-ae7f46b930b3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:19.313560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7acd99-e503-41f0-8978-219b369e04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:19.314432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7acd99-e503-41f0-8978-219b369e04e6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:19.314718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7acd99-e503-41f0-8978-219b369e04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:19.314997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7acd99-e503-41f0-8978-219b369e04e6 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:19.316255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7acd99-e503-41f0-8978-219b369e04e6 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:19.317780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7acd99-e503-41f0-8978-219b369e04e6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:19.319735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:19 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:19.328828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:19.375242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:19.469381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03991e61-32a5-412b-8cfe-d8e4fecf6e0f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:19.470455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03991e61-32a5-412b-8cfe-d8e4fecf6e0f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:19.470455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03991e61-32a5-412b-8cfe-d8e4fecf6e0f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:19.472643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 76/148] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:19.480701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:19.480995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:19.481280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:19.486302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ab43-3f6e-4c61-a7b5-b09e0bbea1d9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:19.509630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:19.513161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:19.556567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:19.600462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:19.601393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:19.601678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:19.601957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004/users/9c84dd4d277646869e0214038b83e040/roles/bb69314e349248aa8762ba2dfc9f71ea` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:19.612666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] RBAC: Authorizing `identity:create_grant(project_id=16f5cac40dc546bd88833a590e407004, user_id=9c84dd4d277646869e0214038b83e040, role_id=bb69314e349248aa8762ba2dfc9f71ea)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:19.614803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:19.658472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 73/149] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:19 2022] PUT /identity/v3/projects/16f5cac40dc546bd88833a590e407004/users/9c84dd4d277646869e0214038b83e040/roles/bb69314e349248aa8762ba2dfc9f71ea => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:19.673015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 77/150] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:19.737262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:19.852413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:19.868764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165585e0-faf0-4482-b5b0-194e3f9d1326 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:19.906137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:19.906965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:19.907251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:19.907531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:19.919975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:19.928050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:19.928980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:19.929800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 74/151] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:19.935393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:20.113769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92ccc-3def-4fb1-b4b3-961ac3ea6d5a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:20.155473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:20.156199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:20.156510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:20.156817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:20.157598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:20.157910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:20.159407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:20.171933 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 78/152] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:20.177354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:20.290629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74b740-d27c-4c49-b2b3-4f0fbb8f8d34 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:20.330144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:20.331042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:20.331326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:20.331606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:20.336598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:20.338090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:20.339822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:20 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:20.345522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:20.378287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:20.468744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d9c0-2794-4d53-b043-78b1c10c56ad None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:20.506576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:20.507262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:20.507548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:20.507861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:20.581022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:20.582504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:20.607382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:20.691315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:20.693546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:20.709921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:20.813206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c450f29-a5d3-4bbb-b144-1604099aea45 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:20.855794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb831e-1fe2-48b1-8c66-abb5eda6685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:20.856681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb831e-1fe2-48b1-8c66-abb5eda6685c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:20.856970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb831e-1fe2-48b1-8c66-abb5eda6685c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:20.857251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb831e-1fe2-48b1-8c66-abb5eda6685c None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:20.858472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb831e-1fe2-48b1-8c66-abb5eda6685c None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:20.860034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb831e-1fe2-48b1-8c66-abb5eda6685c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:20.867232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:20 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:20.868630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:20.915822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc275-3a65-4ee5-b494-e2092fce9b74 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:20.916137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc275-3a65-4ee5-b494-e2092fce9b74 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:20.916387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc275-3a65-4ee5-b494-e2092fce9b74 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:20.917785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 77/156] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:20.933128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149a549-dcb7-475c-ba06-3c7322762eea None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:20.933442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149a549-dcb7-475c-ba06-3c7322762eea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:20.933692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149a549-dcb7-475c-ba06-3c7322762eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:20.957283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6149a549-dcb7-475c-ba06-3c7322762eea None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:20.959069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6149a549-dcb7-475c-ba06-3c7322762eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:21.069949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fd34f-d45d-4c60-b9ce-342b7e85b18d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:21.110212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:21.121532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:21.123362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4deb-8e42-45e7-b0e4-df610ab7a5a9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.123708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4deb-8e42-45e7-b0e4-df610ab7a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.123966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4deb-8e42-45e7-b0e4-df610ab7a5a9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.125669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 79/158] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:21.137922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f2a48-b787-4b7c-93ae-0a66d0b1bcb3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.138276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f2a48-b787-4b7c-93ae-0a66d0b1bcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.138493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f2a48-b787-4b7c-93ae-0a66d0b1bcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.156989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:21.157681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.157973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.158561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.159418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=4be60a1b42104c2fb599167b6e30dc37) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:21.159754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:21.161737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:21.162894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-587f2a48-b787-4b7c-93ae-0a66d0b1bcb3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:21.164551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-587f2a48-b787-4b7c-93ae-0a66d0b1bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:21.179045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 80/159] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:20 2022] GET /identity/v3/role_assignments?user.id=4be60a1b42104c2fb599167b6e30dc37&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=30419c28dd3c4881a47b462c6717a79e => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:21.179045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:21.182491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:21.303532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 80/160] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:21.306664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15eeec-8aa0-4a3e-abf6-22e36482796b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.306964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15eeec-8aa0-4a3e-abf6-22e36482796b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.307245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15eeec-8aa0-4a3e-abf6-22e36482796b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.315931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 81/161] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:21.322917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.323174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.323412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.363155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:21.364973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:21.387893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87bfe-cff2-4c3a-8700-c437e89bbadc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:21.473070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:21.474449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.474731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.475009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.508773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:21.509359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:21.509994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:21.521507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:21.522407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:21.523163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:21.530323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:21.616902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:21.655785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed607b-27ef-451a-bb56-0cb9d52f40ec None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:21.657462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:21.709861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:21.710684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.710968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.711243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.733024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:21.745814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:21.746718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:21.747481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:21.748162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:21.804254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539bdb4-ede8-4084-9caf-6ff9871aa9c5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:21.877748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:21.878366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:21.878652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:21.878929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:21.879806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:21.880126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:21.881558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:21.900991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:21.901867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:21.962013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641ed80-8ee0-49e1-9c53-d40f4ab46042 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.012941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:22.021387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.022504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.023017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.023497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.048629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:22.057067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:22.057920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:22.058678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:22.067972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 84/166] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:22.069164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:22.155003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4ccad-66df-48ca-a90a-5c8ec5828050 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.172033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:22.217972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.218647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.218929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.219201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.219973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:22.221144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:22.222520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:22.242098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:22.243959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:22.251765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7152d-1aa2-4339-9bad-200af92d2173 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.315893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658cbc-182d-4816-a8d0-cc4e26c027d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.316834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658cbc-182d-4816-a8d0-cc4e26c027d5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.317156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658cbc-182d-4816-a8d0-cc4e26c027d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.317714 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658cbc-182d-4816-a8d0-cc4e26c027d5 None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.320573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658cbc-182d-4816-a8d0-cc4e26c027d5 None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:22.322073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658cbc-182d-4816-a8d0-cc4e26c027d5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:22.325375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 85/168] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:22 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:22.326458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e685a-7f36-436d-8152-93bc21f8e3fe None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.326742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e685a-7f36-436d-8152-93bc21f8e3fe None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.327018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e685a-7f36-436d-8152-93bc21f8e3fe None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.328313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 86/169] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:22.329010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e685a-7f36-436d-8152-93bc21f8e3fe None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:22.430440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5d8ec-570e-4a64-aacb-565c1b65c65c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.452972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:22.495565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.496268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.496549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.496823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.497578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:22.497884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:22.499255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc2ff-d386-405a-9ea4-3ff10b9f193f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:22.518006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 84/170] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:22.521286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.521579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.521855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.533612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e685a-7f36-436d-8152-93bc21f8e3fe None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.552414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:22.553625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:22.594009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.594956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.595234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.595556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] PATH_INFO: `/v3/users/4be60a1b42104c2fb599167b6e30dc37` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.596810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] RBAC: Authorizing `identity:get_user(user_id=4be60a1b42104c2fb599167b6e30dc37)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:22.599648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:22.602892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 87/171] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:22 2022] GET /identity/v3/users/4be60a1b42104c2fb599167b6e30dc37 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:22.603662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:22.612093 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:22.701752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 85/172] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:22.702780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:22.821755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a9452-6bcf-44c3-9ad1-502e8b31ec26 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.884836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:22.903602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ddf6-93ee-48ae-a010-87d8459dfe88 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:22.908464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.909152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.909445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.909725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.940688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:22.941582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:22.941861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:22.942704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] PATH_INFO: `/v3/users/b23a970af9624514b8673afe5569bf18` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:22.943983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b23a970af9624514b8673afe5569bf18)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:22.945542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:22.947187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 86/173] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:22 2022] GET /identity/v3/users/b23a970af9624514b8673afe5569bf18 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:22.947972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:22.980143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.006863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.008376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.055297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c17f7-a759-4966-88af-d18f3de145f2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.094254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.094912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.095422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.095530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.115392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 88/174] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:23.116584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.146684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.174958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.176985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.209511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.227696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8265-52fe-4f01-babc-40e930922a5c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.263309 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90036277-4031-4f00-8857-8c49e97e2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.264079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90036277-4031-4f00-8857-8c49e97e2030 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.264353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90036277-4031-4f00-8857-8c49e97e2030 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.264630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90036277-4031-4f00-8857-8c49e97e2030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.274784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90036277-4031-4f00-8857-8c49e97e2030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:23.281894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 87/175] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-90036277-4031-4f00-8857-8c49e97e2030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:23.282489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:23.283345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:23.284141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:23.284716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.284791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 89/176] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:23.286972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698b00-92c6-4e72-9eed-d6f57c58c4e6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.287264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698b00-92c6-4e72-9eed-d6f57c58c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.287609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698b00-92c6-4e72-9eed-d6f57c58c4e6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.289089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 90/177] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:23.290181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f640-3f46-45fa-9029-10b1de8cd3a8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.290473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f640-3f46-45fa-9029-10b1de8cd3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.290751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f640-3f46-45fa-9029-10b1de8cd3a8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.292165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 91/178] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:23.296661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f640-3f46-45fa-9029-10b1de8cd3a8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.382087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590823e-5efa-4656-9849-882a05d36959 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.385548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.399586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f640-3f46-45fa-9029-10b1de8cd3a8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.411106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.417294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3c47d-5adc-4c6f-b8c8-d97491671663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.417954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3c47d-5adc-4c6f-b8c8-d97491671663 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.418240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3c47d-5adc-4c6f-b8c8-d97491671663 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.418515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3c47d-5adc-4c6f-b8c8-d97491671663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.433529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad614cbc-f594-4287-96d5-6d72a0e69a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.434398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614cbc-f594-4287-96d5-6d72a0e69a21 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.434679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614cbc-f594-4287-96d5-6d72a0e69a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.434954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad614cbc-f594-4287-96d5-6d72a0e69a21 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.436176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad614cbc-f594-4287-96d5-6d72a0e69a21 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.437653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad614cbc-f594-4287-96d5-6d72a0e69a21 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.439390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 92/179] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:23.440670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eedaf8-804d-4b0c-9421-6c3e3bac196a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.440963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eedaf8-804d-4b0c-9421-6c3e3bac196a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.441243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eedaf8-804d-4b0c-9421-6c3e3bac196a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.447047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 93/180] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:23.447047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eedaf8-804d-4b0c-9421-6c3e3bac196a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.491434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3c47d-5adc-4c6f-b8c8-d97491671663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.493048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3c47d-5adc-4c6f-b8c8-d97491671663 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.546713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eedaf8-804d-4b0c-9421-6c3e3bac196a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.582310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.583926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.584215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.584488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] PATH_INFO: `/v3/projects/4e64111b4a76410baba309d689d49731` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.585675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] RBAC: Authorizing `identity:get_project(project_id=4e64111b4a76410baba309d689d49731)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.587152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.589076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 94/181] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/projects/4e64111b4a76410baba309d689d49731 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:23.589653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.601145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:23.602393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbe3a-27a9-4bd6-870d-c56711c3fcf6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.602678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbe3a-27a9-4bd6-870d-c56711c3fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.602955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdbe3a-27a9-4bd6-870d-c56711c3fcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.615217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.619922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-89fdbe3a-27a9-4bd6-870d-c56711c3fcf6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:23.621201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-89fdbe3a-27a9-4bd6-870d-c56711c3fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:23.645008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.689820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 89/183] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:23.691534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764aee9-8922-4fbf-8c42-18d3b6965ae3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.691844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725195b5-cb21-4300-a5a7-05db54bd35fb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.691965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764aee9-8922-4fbf-8c42-18d3b6965ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.692608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764aee9-8922-4fbf-8c42-18d3b6965ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.708847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5764aee9-8922-4fbf-8c42-18d3b6965ae3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:23.710045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5764aee9-8922-4fbf-8c42-18d3b6965ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:23.737355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.738033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.738313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.738592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.740051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:23.740823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.742235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.750388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 95/184] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:23.751191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.776981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:23.778475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.778777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.779059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.800059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:23.801195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:23.843549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.858668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5bf3-09aa-465f-b6fc-128b15426371 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:23.873388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 91/186] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:23.887922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.894360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:23.895030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:23.895351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:23.895627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:23.896504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] RBAC: Adding query filter params (role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=4be60a1b42104c2fb599167b6e30dc37) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:23.896634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:23.896821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:23.898373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:23.904973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 96/187] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/role_assignments?user.id=4be60a1b42104c2fb599167b6e30dc37&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:23.905760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:23.988503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7e26e-83a5-4595-a43e-1f978d0b1662 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.027136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d16a-d606-4ee1-a571-abc8e8dee7fc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.027372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.028055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.028345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.028621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.029471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=4e64111b4a76410baba309d689d49731, user.id=4be60a1b42104c2fb599167b6e30dc37) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:24.029789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.031261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.044193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 92/188] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/role_assignments?user.id=4be60a1b42104c2fb599167b6e30dc37&scope.project.id=4e64111b4a76410baba309d689d49731&role.id=30419c28dd3c4881a47b462c6717a79e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:24.045162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.067425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.068267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.068552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.068828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.071331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.072919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.075068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 97/189] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:23 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:24.075593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.108036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.172135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.193564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1daa8-4468-405a-9aa6-a417462da028 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.232239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.233061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.233350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.233628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.233929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fa5e-8d83-43f0-994a-5d817de57c41 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.254310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:24.265427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:24.266333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:24.267508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 93/190] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:24.268514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.282107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.283068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.283356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.283640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] PATH_INFO: `/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.298325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] RBAC: Authorizing `identity:get_user(user_id=19ac1c4ad4b1425f99e64d66b19f82e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.299859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.306469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 98/191] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:24.306469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.371483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa1503-2966-4a04-84f3-2a39a305115d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.381839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.404941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2643d-ae02-4560-bda9-f5898dc7c567 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.405763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.406566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.406860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.407141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.408345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.409796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.411966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 94/192] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:24.412760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.428650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.445517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.446412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.446773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.447057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.457378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:24.465293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:24.466321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:24.467130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 99/193] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:24.467789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.517236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d0069-3c5f-4da9-a2eb-1323813b633e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.552567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.553334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.553621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.553902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.554733 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=b23a970af9624514b8673afe5569bf18) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:24.555048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.556515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.562870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 95/194] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/role_assignments?user.id=b23a970af9624514b8673afe5569bf18&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:24.563667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.582313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fa993-9ce9-45c5-bbf6-fa8de162e130 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.624819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.625424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.625709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.625993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.626874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:24.627078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.628543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.631848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.639491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 100/195] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:24.640566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.656056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.683174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f62f8-af7e-402a-bf75-9c17cbee6bfd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.723978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.724944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.725233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.725525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.766673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd15bfe-a45f-40e9-8db7-116bb99c13f6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:24.810718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:24.811405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:24.811690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:24.812059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:24.812284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.812778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:24.813769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.814258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:24.839051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 101/196] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:24 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:24.839912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.907986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.912167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:24.940658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:24.941650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:24.974339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b6ca0-7c95-4bb9-a4e7-4de6f3ad6066 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.016524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.017226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.017496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.017773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.018710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:25.019024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.021628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.030847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 102/198] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:25.035205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.070737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c862-f9f1-4aa7-8bb6-2d7f6ff849b5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.112591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed239044-200d-479b-840f-36987713e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.113484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239044-200d-479b-840f-36987713e119 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.113771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239044-200d-479b-840f-36987713e119 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.114632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239044-200d-479b-840f-36987713e119 None admin] PATH_INFO: `/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.116581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed239044-200d-479b-840f-36987713e119 None admin] RBAC: Authorizing `identity:get_user(user_id=19ac1c4ad4b1425f99e64d66b19f82e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.118240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed239044-200d-479b-840f-36987713e119 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.120479 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:24 2022] GET /identity/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:25.121197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed239044-200d-479b-840f-36987713e119 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.178325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.180966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f95f21-c3dc-49a2-8cef-67946dd60751 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.200925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.220476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.221351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.221635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.221912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.223175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.225221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.231743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 103/200] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:25.231743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.247434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed239044-200d-479b-840f-36987713e119 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.298262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.299586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.299916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.300208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] PATH_INFO: `/v3/users/9c84dd4d277646869e0214038b83e040` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.302230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] RBAC: Authorizing `identity:get_user(user_id=9c84dd4d277646869e0214038b83e040)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.304463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.306714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/users/9c84dd4d277646869e0214038b83e040 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:25.308005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.353568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2029-828a-4391-b6a7-6790d0222eee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.396863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.397528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.397931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.398304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.429928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43224c8-f149-4514-93ff-f0823b458f4a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.444269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.457004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.468343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.469273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.469728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.470167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.471160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=19ac1c4ad4b1425f99e64d66b19f82e4) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:25.471632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.473275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.475958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.477519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.480739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 99/202] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/role_assignments?user.id=19ac1c4ad4b1425f99e64d66b19f82e4&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:25.481901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.591018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 104/203] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:25.596903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.599539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca780b2-ab5b-4eb8-a510-6b540fc52668 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.639550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.640622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.641089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.641537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.689647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.693303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.710241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ee51-f5a8-4f07-8b5d-9c5d5ef5d0ac None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.719128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.720996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.758959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.759896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.760180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.760455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.761936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.763556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.765906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:25.771498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.841988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:25.850275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:25.889807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe413-27f9-470a-b3ca-b62c3de6d87c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:25.929457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:25.930499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:25.931074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:25.931624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:25.932852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] RBAC: Adding query filter params (role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=19ac1c4ad4b1425f99e64d66b19f82e4) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:25.933389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:25.935272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:25.941565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 106/206] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/role_assignments?user.id=19ac1c4ad4b1425f99e64d66b19f82e4&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:25.971484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:26.010047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b4a90-a885-41c5-8482-669a38984798 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:26.060165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f6a50-3aa2-4a7e-8d88-3a50235fb0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:26.061419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6a50-3aa2-4a7e-8d88-3a50235fb0aa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:26.061899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6a50-3aa2-4a7e-8d88-3a50235fb0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:26.062392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6a50-3aa2-4a7e-8d88-3a50235fb0aa None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:26.068670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f6a50-3aa2-4a7e-8d88-3a50235fb0aa None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:26.070522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f6a50-3aa2-4a7e-8d88-3a50235fb0aa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:26.073039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:25 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:26.079271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:26.101794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:26.192978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3120-b008-4b9f-9f06-80a1af90cbc6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:26.229228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:26.230294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:26.230792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:26.231308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:26.232398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] RBAC: Adding query filter params (role.id=bb69314e349248aa8762ba2dfc9f71ea, scope.project.id=16f5cac40dc546bd88833a590e407004, user.id=9c84dd4d277646869e0214038b83e040) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:26.232972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:26.234660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717efdb8-b74d-4fe4-a473-ab55648cc8c1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:26.241750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:26 2022] GET /identity/v3/role_assignments?user.id=9c84dd4d277646869e0214038b83e040&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=bb69314e349248aa8762ba2dfc9f71ea => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:27.270976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a603-7294-4128-b412-04ef8dbe7c2c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.271559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a603-7294-4128-b412-04ef8dbe7c2c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.271559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9a603-7294-4128-b412-04ef8dbe7c2c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.273156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:27.278637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91d9b-8e75-4cb3-9f3b-a16c0b0db8c0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.279051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91d9b-8e75-4cb3-9f3b-a16c0b0db8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.279247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91d9b-8e75-4cb3-9f3b-a16c0b0db8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.296396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e1b91d9b-8e75-4cb3-9f3b-a16c0b0db8c0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:27.297575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e1b91d9b-8e75-4cb3-9f3b-a16c0b0db8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:27.369696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:27.393228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9a603-7294-4128-b412-04ef8dbe7c2c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.478846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18733423-1d7b-4fc6-8f9b-7573ba7a0372 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.479490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18733423-1d7b-4fc6-8f9b-7573ba7a0372 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.479917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18733423-1d7b-4fc6-8f9b-7573ba7a0372 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.481645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 109/211] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:27.486670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.487062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.487441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.498457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9a603-7294-4128-b412-04ef8dbe7c2c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:27.510882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:27.511940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:27.520095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:27.539603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:27.540724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.541197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.541830 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.555472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:27.563730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:27.564586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:27.565348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:27.567769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 103/212] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:27.573564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.577686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:27.588966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 110/213] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:27.613825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.686836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c195c-91c6-43ea-945f-460df5e2141e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:27.727039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877201-67cf-4e08-bada-3622d47c1d53 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:27.727228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:27.727740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.728051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.728327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.729092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:27.729402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:27.731537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:27.741038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 104/214] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:27.749143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.775380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:27.776228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.776510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.776788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.777998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:27.780120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:27.783813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 111/215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:27.788276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.811175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:27.843429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:27.888646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868b1d0-6870-4ce7-bec1-821a60cb7aaf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:27.929168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931dfb9-6193-4ef6-891e-2f3d8ac3edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:27.930050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931dfb9-6193-4ef6-891e-2f3d8ac3edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.930337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931dfb9-6193-4ef6-891e-2f3d8ac3edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.930617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931dfb9-6193-4ef6-891e-2f3d8ac3edb3 None admin] PATH_INFO: `/v3/users/e06e2f2d5c814a95a0d4e48a706bc5e7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.933259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b7524-d850-4f52-9a10-78a5ad72c642 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:27.954405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931dfb9-6193-4ef6-891e-2f3d8ac3edb3 None admin] RBAC: Authorizing `identity:get_user(user_id=e06e2f2d5c814a95a0d4e48a706bc5e7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:27.955983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931dfb9-6193-4ef6-891e-2f3d8ac3edb3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:27.958603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 105/216] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:27 2022] GET /identity/v3/users/e06e2f2d5c814a95a0d4e48a706bc5e7 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:27.964182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e777-462c-4569-b4ed-6ee716c4229b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.964416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e777-462c-4569-b4ed-6ee716c4229b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.964695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e777-462c-4569-b4ed-6ee716c4229b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.965978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 106/217] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:27.966674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e777-462c-4569-b4ed-6ee716c4229b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:27.976160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ac7c-e2fc-49bf-9b69-c539b86fd8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:27.976850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ac7c-e2fc-49bf-9b69-c539b86fd8c5 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.977139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ac7c-e2fc-49bf-9b69-c539b86fd8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.977415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ac7c-e2fc-49bf-9b69-c539b86fd8c5 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:27.978133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ac7c-e2fc-49bf-9b69-c539b86fd8c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:27.979582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ac7c-e2fc-49bf-9b69-c539b86fd8c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:27.999963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 112/218] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:27 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:27.999963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:27.999963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:27.999963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.025551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:28.026789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:28.105967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e777-462c-4569-b4ed-6ee716c4229b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.116781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:28.129260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 113/219] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:28.149184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:28.152437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.170842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.172096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.172383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.172656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.264442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:28.265901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:28.272147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eae1f-ba4c-4377-be19-40b6d5b67ba0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.322028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f5f8-af22-4de5-b94f-aa91e2fea170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.322837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f5f8-af22-4de5-b94f-aa91e2fea170 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.323114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f5f8-af22-4de5-b94f-aa91e2fea170 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.323385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f5f8-af22-4de5-b94f-aa91e2fea170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.338357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8f5f8-af22-4de5-b94f-aa91e2fea170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2ba8f5f8-af22-4de5-b94f-aa91e2fea170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:28.346202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:28.347097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:28.347931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 114/220] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:28.349396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19311-3c79-4b6b-9913-9b772c6065b2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.349396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19311-3c79-4b6b-9913-9b772c6065b2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.349396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19311-3c79-4b6b-9913-9b772c6065b2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.350845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 115/221] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:28.356386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.356618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.356880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.374390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:28.375555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:28.389930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 107/222] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:28.390869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.421392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:28.458849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:28.483569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 116/223] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:28.484782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.524807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db4f1-8e3d-4864-9ac9-a3aea5a997ec None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.569813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.570809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.571850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.572171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.572940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:28.573250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:28.574628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:28.589008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 108/224] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:28.590308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.608976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e883-1e19-4d81-833d-6d18f42f7fc2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.656295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.657439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.657764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.658045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.659984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:28.661836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:28.664556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 117/225] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:28.665342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.704189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:28.726266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216afa-080b-4213-bf81-5fbb0c9616f6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.741449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:28.769815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.771334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.771749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.772131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.784982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:28.793760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:28.794689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:28.795449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:28.799897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 109/226] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:28.800826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.801477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7011-ef37-458a-95c3-b10cd9f4d040 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:28.865803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:28.867577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:28.868063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:28.868513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] PATH_INFO: `/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:28.869990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] RBAC: Authorizing `identity:get_user(user_id=19ac1c4ad4b1425f99e64d66b19f82e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:28.872460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:28.880986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 118/227] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:28.881834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:28.952196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f43013-268c-4a4f-8b4b-55b04fa0fa0b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.008740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.009800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.010271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.010824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.012238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=e06e2f2d5c814a95a0d4e48a706bc5e7) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:29.013003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.014394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419002fa-2d75-42d0-a0ce-48440c7db031 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.015442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.024401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 110/228] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/role_assignments?user.id=e06e2f2d5c814a95a0d4e48a706bc5e7&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=30419c28dd3c4881a47b462c6717a79e => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:29.025756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:29.038876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:29.056719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.058307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.058799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.059273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.060343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:29.061098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.063873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.074701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:29.076174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 119/229] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:29.092079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:29.226021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b057f2-528f-4d2e-8ef2-5cb9dfa88cb5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.265958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.267848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.268376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.268857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] PATH_INFO: `/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.271333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] RBAC: Authorizing `identity:get_user(user_id=19ac1c4ad4b1425f99e64d66b19f82e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.273093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.275423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:29 2022] GET /identity/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:29.284786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:29.331170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24504-a3e5-407f-845d-029d1520f03f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.394378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.396987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.397477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.397956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.399639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.401859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.407955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 111/231] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:29 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:29.409404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:29.413457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:29.514036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:29.522213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe258-36de-44ce-aeb1-649f1e2b860a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.540086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdf453-b5f4-45f7-936e-6d8e555bf8aa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.578596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.580034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.580708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.581213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/19ac1c4ad4b1425f99e64d66b19f82e4/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.583706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee3d16251f43b7837010500151c1f2, user_id=19ac1c4ad4b1425f99e64d66b19f82e4, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.585835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.615744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 112/232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:29 2022] PUT /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/19ac1c4ad4b1425f99e64d66b19f82e4/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:29.616850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1714ab-96a2-4d9a-859d-39c64898c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.618002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1714ab-96a2-4d9a-859d-39c64898c776 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.618514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1714ab-96a2-4d9a-859d-39c64898c776 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.619003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1714ab-96a2-4d9a-859d-39c64898c776 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.620683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1714ab-96a2-4d9a-859d-39c64898c776 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.622486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1714ab-96a2-4d9a-859d-39c64898c776 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.628315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 121/233] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:29 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:29.632908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:29.807912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5695-233f-4775-a71b-088956d1acdc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:29.849494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924300ad-1a14-477e-b0e3-d687fc095ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:29.850400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924300ad-1a14-477e-b0e3-d687fc095ba3 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:29.850683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924300ad-1a14-477e-b0e3-d687fc095ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:29.850960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924300ad-1a14-477e-b0e3-d687fc095ba3 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/19ac1c4ad4b1425f99e64d66b19f82e4/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:29.853264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924300ad-1a14-477e-b0e3-d687fc095ba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee3d16251f43b7837010500151c1f2, user_id=19ac1c4ad4b1425f99e64d66b19f82e4, role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:29.854712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924300ad-1a14-477e-b0e3-d687fc095ba3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:29.866419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:29.872310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:29 2022] PUT /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/19ac1c4ad4b1425f99e64d66b19f82e4/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:30.366897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3acbe-22b4-45a4-b8e4-ed674da52faf None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:30.367280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3acbe-22b4-45a4-b8e4-ed674da52faf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:30.367460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3acbe-22b4-45a4-b8e4-ed674da52faf None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:30.369191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 122/235] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:30.374838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:30.375133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:30.375412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:30.393324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:30.394524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:30.484094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 114/236] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:30.533237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3acbe-22b4-45a4-b8e4-ed674da52faf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:30.660689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3acbe-22b4-45a4-b8e4-ed674da52faf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:30.679206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:30.697964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75076-15e3-48c1-9b84-d1e0f6dd5781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:30.698775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75076-15e3-48c1-9b84-d1e0f6dd5781 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:30.699065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75076-15e3-48c1-9b84-d1e0f6dd5781 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:30.699343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75076-15e3-48c1-9b84-d1e0f6dd5781 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:30.710134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd75076-15e3-48c1-9b84-d1e0f6dd5781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ebd75076-15e3-48c1-9b84-d1e0f6dd5781 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:30.718189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:30.719058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:30.719848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:30.723826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 123/237] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:30.726009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:30.850902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527d6b8-09cc-41ad-80fe-0ee1903320fa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:30.865083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153068b-83c6-4b6f-9d70-0057512cc220 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:30.865372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153068b-83c6-4b6f-9d70-0057512cc220 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:30.865651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153068b-83c6-4b6f-9d70-0057512cc220 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:30.867053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 124/238] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:30.872261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:30.872901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:30.873251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:30.892073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:30.898470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:30.899657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:30.905606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:30.906284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:30.906563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:30.906834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:30.907585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:30.907911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:30.909273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:30.928941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 115/239] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:30.934923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.011821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 125/240] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:31.032298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.070072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b150a3-bb3d-4dde-8cbf-8f2cca31e424 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:31.114810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:31.115702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.116013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.116468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] PATH_INFO: `/v3/users/5abec22583ca4971a5c9bd0901e877f5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.137074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8e62-83e1-457c-b150-3d0ebb458bee None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:31.152507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] RBAC: Authorizing `identity:get_user(user_id=5abec22583ca4971a5c9bd0901e877f5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:31.154065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:31.156243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 116/241] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:30 2022] GET /identity/v3/users/5abec22583ca4971a5c9bd0901e877f5 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:31.161926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.163045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:31.188435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:31.189149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.189426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.189693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.191577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:31.193603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:31.201941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 126/242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:31.207201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.270474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:31.341688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d8753-6c0d-403c-b3dc-0a8282378c0a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:31.398636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12381cf-1324-4f83-a2f4-67bb670a5e68 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:31.410697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:31.411991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.412415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.412829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.445742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e134c-c84d-461e-89c6-cd11a3dc022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:31.446351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e134c-c84d-461e-89c6-cd11a3dc022f None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.446639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e134c-c84d-461e-89c6-cd11a3dc022f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.446921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e134c-c84d-461e-89c6-cd11a3dc022f None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.447643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e134c-c84d-461e-89c6-cd11a3dc022f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:31.449128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e134c-c84d-461e-89c6-cd11a3dc022f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:31.493801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 127/243] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:31 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:31.526829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:31.528370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:31.574104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbaa2a-5ed3-4cbe-8cdf-d625cbb2d8c6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.574806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbaa2a-5ed3-4cbe-8cdf-d625cbb2d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.575100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbaa2a-5ed3-4cbe-8cdf-d625cbb2d8c6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.577298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 128/244] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:31.584258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.584685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.584972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.585995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:31.637674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:31.639170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:31.665399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 117/245] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:31.673175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.702872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:31.783197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 129/246] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:31.813033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.823227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229a26-5298-4d59-ab43-33b24997922d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:31.866869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:31.868340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.868629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.868904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:31.870265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:31.872245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:31.874575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 118/247] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:31 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:31.885701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:31.911078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:31.943618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c711e-598b-40c1-afe1-73c5148f1a4f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:31.989947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:31.992193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:31.992637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:31.993062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.006529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:32.014912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b72dfc-a416-43e4-a196-3e1bc3626d9c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:32.015993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:32.016886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:32.017725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:32.023205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 130/248] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:32.029407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:32.056680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.057768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.058723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.059209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.060290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] RBAC: Adding query filter params (role.id=bb69314e349248aa8762ba2dfc9f71ea, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=5abec22583ca4971a5c9bd0901e877f5) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:32.060811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:32.062545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:32.066939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:32.073904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 119/249] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:31 2022] GET /identity/v3/role_assignments?user.id=5abec22583ca4971a5c9bd0901e877f5&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=bb69314e349248aa8762ba2dfc9f71ea => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:32.171253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66309e8-3585-4fad-a52e-228b0abf4950 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.211869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.212956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.213447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.213930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.214924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:32.215462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:32.217154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117e3d-b7d9-4af4-b129-487534cab3bd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:32.227958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 131/250] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:32.234250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:32.306639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625193ce-075b-4c52-8be7-3067822ec5d1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.306932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625193ce-075b-4c52-8be7-3067822ec5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.307127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625193ce-075b-4c52-8be7-3067822ec5d1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.308913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 132/251] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:32.314189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.314552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.314837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.331170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:32.334448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:32.335743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:32.354605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87b2be-5379-46da-b758-788ba8f96ec4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.396556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.397552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.397846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.398131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] PATH_INFO: `/v3/users/e06e2f2d5c814a95a0d4e48a706bc5e7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.399539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] RBAC: Authorizing `identity:get_user(user_id=e06e2f2d5c814a95a0d4e48a706bc5e7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:32.401180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:32.403231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 120/252] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:32 2022] GET /identity/v3/users/e06e2f2d5c814a95a0d4e48a706bc5e7 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:32.411092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:32.415671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 133/253] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:32.444749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:32.467060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:32.562389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46679307-e029-47b3-bf2b-d361f0926427 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.568990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1370a0-12d1-4c40-98cb-239fbd82cf6b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.599843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.600759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.601052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.601330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.618586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.619463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.621327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.621602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.622969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:32.624678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:32.626536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:32.626798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 121/254] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:32 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:32.639084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:32.640268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:32.641249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 134/255] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:32.646630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:32.647057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:32.693797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:32.733319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:32.763097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124013-b0bf-4113-91f9-581d865f5fcd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.805906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd07d71-e2c5-4e94-8b9b-66c690729d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.806875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07d71-e2c5-4e94-8b9b-66c690729d4a None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.807161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07d71-e2c5-4e94-8b9b-66c690729d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.807442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07d71-e2c5-4e94-8b9b-66c690729d4a None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/e06e2f2d5c814a95a0d4e48a706bc5e7/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.809627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd07d71-e2c5-4e94-8b9b-66c690729d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee3d16251f43b7837010500151c1f2, user_id=e06e2f2d5c814a95a0d4e48a706bc5e7, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:32.811118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd07d71-e2c5-4e94-8b9b-66c690729d4a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:32.835099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 135/256] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:32 2022] PUT /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/e06e2f2d5c814a95a0d4e48a706bc5e7/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:22:32.836485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c655b-c6f9-4def-80e2-c899aff717c8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.836777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c655b-c6f9-4def-80e2-c899aff717c8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.837060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c655b-c6f9-4def-80e2-c899aff717c8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.844005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 136/257] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:32.853442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.854132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.854616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.893318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:32.898010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:32.916602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba211b7-2fe5-4eb4-983b-8182834a97e6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:32.969313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:32.970010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:32.970290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:32.970562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:32.971325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:32.971628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:32.973331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:32.983250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 122/258] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:32.992787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:33.022619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 137/259] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:33.048345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:33.103930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.122180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.131634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea600b-46c6-417c-a475-0c451f71035b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:33.166740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272bcab-9121-4582-a1a9-de41d2ebb76c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:33.168856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:33.170510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:33.170510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:33.170510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] PATH_INFO: `/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:33.171521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] RBAC: Authorizing `identity:get_user(user_id=19ac1c4ad4b1425f99e64d66b19f82e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:33.173020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:33.175005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 123/260] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:32 2022] GET /identity/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:33.181006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:33.206311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:33.207527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:33.208042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:33.208523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:33.221240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:33.232778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:33.233757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:33.234529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:33.237786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 138/261] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:33.244320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:33.358008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3839f-15ec-4501-9ba0-c2d17f0a6845 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:33.364484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd045d8-f245-4e64-9179-dfc987a8d4ec None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:33.417511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.437536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:33.438222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:33.438504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:33.438778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:33.439538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:33.439868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:33.441594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:33.444431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:33.445110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:33.445398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:33.445679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:33.463330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 139/262] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:33.469013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:33.485357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.633945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:33.635339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:33.670701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f0809-92fa-4c54-8c66-0dd3a0bae6be None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:33.744712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:33.745616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:33.745903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:33.746185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] PATH_INFO: `/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:33.747422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] RBAC: Authorizing `identity:get_user(user_id=19ac1c4ad4b1425f99e64d66b19f82e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:33.748927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:33.751647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 140/263] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:33 2022] GET /identity/v3/users/19ac1c4ad4b1425f99e64d66b19f82e4 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:33.758958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:33.897027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.907587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 124/264] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:33.915847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:34.002292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc436e-925d-40f4-8a25-4ad4c2629b79 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:34.027744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:34.093491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:34.094547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:34.095039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:34.095559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:34.151081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69e623-984d-4705-a584-c79692f2a5e0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:34.224538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:34.226017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:34.240428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:34.241328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:34.241865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:34.242056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:34.243372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:34.244857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:34.246591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 125/265] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:33 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:34.252317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:34.342400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:34.432585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730325c-f370-4567-8c4b-4d8245147531 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:34.459869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:34.460475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 141/266] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:34.468759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:34.504490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:34.505526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:34.506042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:34.506519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:34.507569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=19ac1c4ad4b1425f99e64d66b19f82e4) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:34.508118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:34.509763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:34.516911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 126/267] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:34 2022] GET /identity/v3/role_assignments?user.id=19ac1c4ad4b1425f99e64d66b19f82e4&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:34.615053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f987f-bc13-4f45-b1a2-ded6351f937e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:34.665921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ce781-0447-40d2-9a9b-8c2687cfe1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:34.667148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ce781-0447-40d2-9a9b-8c2687cfe1eb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:34.667635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ce781-0447-40d2-9a9b-8c2687cfe1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:34.668135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ce781-0447-40d2-9a9b-8c2687cfe1eb None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:34.669563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ce781-0447-40d2-9a9b-8c2687cfe1eb None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:34.671368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ce781-0447-40d2-9a9b-8c2687cfe1eb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:34.674135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 142/268] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:34 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:34.679739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:34.807123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b786aa-896c-42e2-a59f-3a00184744ec None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:34.858922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:34.859598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:34.859912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:34.860256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:34.861128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] RBAC: Adding query filter params (role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=19ac1c4ad4b1425f99e64d66b19f82e4) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:34.861474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:34.862937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d975f-536e-40f2-a4e1-5c2137b73d19 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:34.869722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 127/269] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:34 2022] GET /identity/v3/role_assignments?user.id=19ac1c4ad4b1425f99e64d66b19f82e4&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:35.107694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304234c-8d91-488f-8ad6-b9a12d33112c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.108009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304234c-8d91-488f-8ad6-b9a12d33112c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.108204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304234c-8d91-488f-8ad6-b9a12d33112c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.109964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 143/270] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:35.115886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28933e-90a8-4538-a0cf-153d88188a7e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.116178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28933e-90a8-4538-a0cf-153d88188a7e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.116519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28933e-90a8-4538-a0cf-153d88188a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.119231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3dd7-5dff-4849-bca0-997a9bd394de None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.119523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3dd7-5dff-4849-bca0-997a9bd394de None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.119841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3dd7-5dff-4849-bca0-997a9bd394de None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.121506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 144/271] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:35.126751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.127299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.127853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.141997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ab28933e-90a8-4538-a0cf-153d88188a7e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:35.143199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ab28933e-90a8-4538-a0cf-153d88188a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:35.158116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:35.159794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:35.180823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.187206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.229041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 128/272] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:35.230775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fa833-6c3e-4ed5-81dd-38859b6e3dd0 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.231062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fa833-6c3e-4ed5-81dd-38859b6e3dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.231338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fa833-6c3e-4ed5-81dd-38859b6e3dd0 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.235802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 129/273] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:35.240114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.240401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.240671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.257791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 145/274] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:35.259035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.260565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:35.261903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:35.346851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 130/275] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:35.356586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.373270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7746e7-36ea-4a0d-a630-6b79b0dc21a0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.409092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.410292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.411178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.411459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.413043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:35.414820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:35.416499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 146/276] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:35.416499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.440075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.482348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb080f-947a-42d7-a589-81fd00a911f1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.484291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.520614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.521434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.521708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.521984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.524117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd6396-597c-4295-b569-de6e673a2b2c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.533094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:35.540841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:35.541705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:35.542555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 131/277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:35.543226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.564812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.565613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.565894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.566166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.577175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:35.585513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:35.586399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:35.587195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 147/278] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:35.592755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.657540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08427bd1-2287-4d69-bfc7-4c9afdd6131d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.682670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.704224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.704907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.705177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d1789-d5b6-464c-81b7-5718ff247dba None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.705288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.705448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.706159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:35.708062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:35.739746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 132/279] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:22:35 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:35.739746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.752393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.753081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.753362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.753683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.755112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:35.755423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:35.757090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:35.761433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.770852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 148/280] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:35.781490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.866885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271fe7-091d-41b7-b962-58f3645b91f6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.908912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.909855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.910174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.910536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.911356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:35.911839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:35.913291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:35.920633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1786-5e9a-4c6b-a4ff-a4e3723b117b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:35.922840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 133/281] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:35.931283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:35.964539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:35.965781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:35.966477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:35.966870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] PATH_INFO: `/v3/users/4a100a6f0ef94ec295d9d034023132d5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:35.986008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:35.993373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] RBAC: Authorizing `identity:get_user(user_id=4a100a6f0ef94ec295d9d034023132d5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:36.001081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:36.003400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 149/282] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/users/4a100a6f0ef94ec295d9d034023132d5 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:36.008890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:36.033777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:36.063565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81333c80-7a7b-4824-ba6c-fa8c7607261f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:36.103679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d5a89-e05e-41c4-bca5-0b1bb89a1e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:36.104640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5a89-e05e-41c4-bca5-0b1bb89a1e7d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.104927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5a89-e05e-41c4-bca5-0b1bb89a1e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.105205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5a89-e05e-41c4-bca5-0b1bb89a1e7d None admin] PATH_INFO: `/v3/users/5abec22583ca4971a5c9bd0901e877f5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.107627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d5a89-e05e-41c4-bca5-0b1bb89a1e7d None admin] RBAC: Authorizing `identity:get_user(user_id=5abec22583ca4971a5c9bd0901e877f5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:36.109120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d5a89-e05e-41c4-bca5-0b1bb89a1e7d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:36.110837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 134/283] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:35 2022] GET /identity/v3/users/5abec22583ca4971a5c9bd0901e877f5 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:36.112107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f68ec-ca9d-4937-9cfe-63b14c922eef None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.112395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f68ec-ca9d-4937-9cfe-63b14c922eef None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.112674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f68ec-ca9d-4937-9cfe-63b14c922eef None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.114258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 135/284] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:36.116549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f68ec-ca9d-4937-9cfe-63b14c922eef None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:36.148742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f61f2-c5bb-47fe-af28-9595d24e674a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:36.184479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:36.185067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.185412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.185699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.186589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, user.id=4a100a6f0ef94ec295d9d034023132d5, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:36.186908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:36.188404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b4b9-88de-4e8b-860f-8343e48e5340 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:36.194969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 150/285] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 20 09:22:36 2022] GET /identity/v3/role_assignments?user.id=4a100a6f0ef94ec295d9d034023132d5&scope.system=all&role.id=30419c28dd3c4881a47b462c6717a79e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:36.196398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.196744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.197027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.217530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:36.219226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:36.258756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f68ec-ca9d-4937-9cfe-63b14c922eef None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:36.314919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:36.329307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 151/286] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:36.338649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:36.339567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.339877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.340161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.344642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:36.346141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:36.348758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 136/287] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:36 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:36.354560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:36.369277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:36.398888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:36.532627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb92fa1-ed4e-4706-b475-d7a299643e40 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:36.535236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0220e-fc29-4649-81d1-d32a0223c020 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:36.598013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:36.599918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.600737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.602073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:36.602578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.604239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.604900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.606483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/5abec22583ca4971a5c9bd0901e877f5/roles/bb69314e349248aa8762ba2dfc9f71ea` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.609884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee3d16251f43b7837010500151c1f2, user_id=5abec22583ca4971a5c9bd0901e877f5, role_id=bb69314e349248aa8762ba2dfc9f71ea)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:36.614439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:36.628109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:36.642259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 152/288] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:22:36 2022] PUT /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2/users/5abec22583ca4971a5c9bd0901e877f5/roles/bb69314e349248aa8762ba2dfc9f71ea => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:36.646212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:36.647095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:36.647909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:36.650520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 137/289] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:36.659750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:36.740406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:36.829672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90463f1b-8448-42a6-8a9c-eb92e3bb1afe None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:36.878212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:36.879348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:36.879888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:36.880391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:36.881356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:36.881865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:36.883466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:36.893632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 153/290] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:36.900266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:36.997743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:37.027538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ffdfd-1ae3-4691-9117-541eef886a48 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:37.078415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:37.079222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:37.079502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:37.079806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] PATH_INFO: `/v3/users/e06e2f2d5c814a95a0d4e48a706bc5e7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:37.081054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] RBAC: Authorizing `identity:get_user(user_id=e06e2f2d5c814a95a0d4e48a706bc5e7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:37.083104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:37.085057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 138/291] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:36 2022] GET /identity/v3/users/e06e2f2d5c814a95a0d4e48a706bc5e7 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:37.090402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:37.255011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf032b0-726a-492b-915f-d4436d89bd8a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:37.275335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:37.305852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:37.306866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:37.307351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:37.307877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:37.400157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:37.401563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:37.545290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 154/292] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:37.552768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:37.730570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0519-3cdb-45e5-a0f0-e2d1a38a5118 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:37.780063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119e67c-dd60-47eb-ae4b-ff73879189ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:37.780936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e67c-dd60-47eb-ae4b-ff73879189ec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:37.781226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e67c-dd60-47eb-ae4b-ff73879189ec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:37.781505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e67c-dd60-47eb-ae4b-ff73879189ec None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:37.782733 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119e67c-dd60-47eb-ae4b-ff73879189ec None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:37.784233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119e67c-dd60-47eb-ae4b-ff73879189ec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:37.786678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 139/293] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:37 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:37.792323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:37.813967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:37.931409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b0c9-5779-49ac-9ac6-c51ddd90fc6d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:37.974182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:37.975275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:37.975785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:37.976284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:37.977317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=e06e2f2d5c814a95a0d4e48a706bc5e7) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:37.977828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:37.979480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe238e-e7d7-4fc9-b256-47a89844830b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:37.989680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 155/294] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:37 2022] GET /identity/v3/role_assignments?user.id=e06e2f2d5c814a95a0d4e48a706bc5e7&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=30419c28dd3c4881a47b462c6717a79e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:38.483551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201f5c0-77f4-4f70-8bf6-a947bda31556 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.483788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928d49-026f-4fc6-b111-6168032d081a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.484069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928d49-026f-4fc6-b111-6168032d081a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.484168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928d49-026f-4fc6-b111-6168032d081a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.484683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201f5c0-77f4-4f70-8bf6-a947bda31556 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.485160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201f5c0-77f4-4f70-8bf6-a947bda31556 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.485793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 140/295] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:38.486967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 156/296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:38.491990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.492264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.492468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.494060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.494550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.495024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.514136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:38.515248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:38.515379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:38.516771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:38.524312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:38.602208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 141/297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:38.621288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 157/298] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:38.631218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:38.654939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:38.668121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:38.738403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1bd9a-016c-4a49-8827-1a278d468372 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:38.763255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3d21d-bb61-4a05-8a7c-be773327c662 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:38.774940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43693506-37b1-4b2e-b92c-afac5442da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:38.776039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693506-37b1-4b2e-b92c-afac5442da86 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.776333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693506-37b1-4b2e-b92c-afac5442da86 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.776611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693506-37b1-4b2e-b92c-afac5442da86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.787712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43693506-37b1-4b2e-b92c-afac5442da86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-43693506-37b1-4b2e-b92c-afac5442da86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:38.795445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:38.796556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:38.797377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 142/299] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:38.798228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02f3a-27f5-4fdc-93b0-c83dfd87ca26 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.798522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02f3a-27f5-4fdc-93b0-c83dfd87ca26 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.798798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02f3a-27f5-4fdc-93b0-c83dfd87ca26 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.800094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 143/300] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:38.806916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02f3a-27f5-4fdc-93b0-c83dfd87ca26 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:38.809691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:38.810177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ee8ed-290b-4b54-ba99-b71c1ffa2aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:38.811089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee8ed-290b-4b54-ba99-b71c1ffa2aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.811498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee8ed-290b-4b54-ba99-b71c1ffa2aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.811656 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee8ed-290b-4b54-ba99-b71c1ffa2aa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.813101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ee8ed-290b-4b54-ba99-b71c1ffa2aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:38.814617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ee8ed-290b-4b54-ba99-b71c1ffa2aa2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:38.820724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 158/301] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:38.820724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.820724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.820724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.842647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:38.843907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:38.914018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 159/302] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:38.920796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:38.936089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:38.938018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02f3a-27f5-4fdc-93b0-c83dfd87ca26 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:38.974291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:38.975020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:38.975311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:38.975591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:38.976463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:38.976697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:38.978070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:38.986969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 144/303] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:38.988104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.043428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51d0f-cf49-4f4a-aca7-346f8b736738 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.058205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.077577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.078259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.078549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.078828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] PATH_INFO: `/v3/groups` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.079523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.080996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.095750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 160/304] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Jul 20 09:22:38 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:39.096585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.099485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031e755-494c-4265-873c-5f8973381d0e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.138547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b154ec-38ab-41aa-be01-20c83a797da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.139942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b154ec-38ab-41aa-be01-20c83a797da8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.140467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b154ec-38ab-41aa-be01-20c83a797da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.140960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b154ec-38ab-41aa-be01-20c83a797da8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.157535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b154ec-38ab-41aa-be01-20c83a797da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d4b154ec-38ab-41aa-be01-20c83a797da8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:39.166864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:39.168132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:39.169035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 145/305] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:39.169720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6c4e-ace9-468e-a3da-75c9c07a3656 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.169720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6c4e-ace9-468e-a3da-75c9c07a3656 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.175544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6c4e-ace9-468e-a3da-75c9c07a3656 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.175544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 146/306] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:39.176542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6c4e-ace9-468e-a3da-75c9c07a3656 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.203033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.247447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd86f9-8208-4c1a-9ee1-d1f6729bc4fc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.290099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b79833-00a3-4f02-bef1-b2cf3a8926e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.290478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b79833-00a3-4f02-bef1-b2cf3a8926e5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.291271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b79833-00a3-4f02-bef1-b2cf3a8926e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.291271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b79833-00a3-4f02-bef1-b2cf3a8926e5 None admin] PATH_INFO: `/v3/users/7e644560bcda4b648230222f20ed0072` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.299595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6c4e-ace9-468e-a3da-75c9c07a3656 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.308045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b79833-00a3-4f02-bef1-b2cf3a8926e5 None admin] RBAC: Authorizing `identity:get_user(user_id=7e644560bcda4b648230222f20ed0072)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.309518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b79833-00a3-4f02-bef1-b2cf3a8926e5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.311600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 161/307] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/users/7e644560bcda4b648230222f20ed0072 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:39.312881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.313164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.313443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.325420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.331295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:39.332512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:39.336788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.337466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.337752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.338028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.338784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:39.339096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.340631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.353945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 147/308] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:39.353945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.412263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 162/309] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:39.413336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.464808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39ca61-d7e5-446f-8820-f8f7ba46430a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.487869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.501133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.501799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.502086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.502363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.503199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] RBAC: Adding query filter params (role.id=bb69314e349248aa8762ba2dfc9f71ea, user.id=7e644560bcda4b648230222f20ed0072, scope.system=all) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:39.503520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.505553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.520580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 148/310] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/role_assignments?user.id=7e644560bcda4b648230222f20ed0072&scope.system=all&role.id=bb69314e349248aa8762ba2dfc9f71ea => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:39.520580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.549883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12acf1e-88c5-4ef7-a17a-7249cd2fa013 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.581872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.594383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.595288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.595688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.596000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] PATH_INFO: `/v3/users/4a100a6f0ef94ec295d9d034023132d5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.597396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] RBAC: Authorizing `identity:get_user(user_id=4a100a6f0ef94ec295d9d034023132d5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.599024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.600924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 163/311] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/users/4a100a6f0ef94ec295d9d034023132d5 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:39.606826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.649667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb29c-d211-453c-8df0-b5f5ddf9ffb0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.699334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.700183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.701065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.701351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.715539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:39.725963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:39.726897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:39.728035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:39.729965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8dad-3670-412e-b7a6-0c8da13ceed3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.731818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 149/312] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:39.734595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:39.760065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.773978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.774850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.775137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.775416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] PATH_INFO: `/v3/system/users/4a100a6f0ef94ec295d9d034023132d5/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.776935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4a100a6f0ef94ec295d9d034023132d5, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.778373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.789418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 164/313] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 20 09:22:39 2022] PUT /identity/v3/system/users/4a100a6f0ef94ec295d9d034023132d5/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:39.866241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d55e-7e76-4caf-bfdb-429295d87427 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:39.879182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:39.911204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:39.912094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:39.912386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:39.912665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:39.913437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:39.913750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:39.915167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:39.925442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 150/314] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:39.931202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:40.042864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab9658-0437-451d-be68-80c2438d6938 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:40.077852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:40.078805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:40.079029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:40.079307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] PATH_INFO: `/v3/users/5abec22583ca4971a5c9bd0901e877f5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:40.080702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] RBAC: Authorizing `identity:get_user(user_id=5abec22583ca4971a5c9bd0901e877f5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:40.082158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:40.083947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 165/315] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:39 2022] GET /identity/v3/users/5abec22583ca4971a5c9bd0901e877f5 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:40.089445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:40.197466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda8892-915b-46ac-a8fb-4e715afcc319 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:40.234413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:40.235052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:40.235345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:40.235625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:40.286318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:40.314440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:40.315940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:40.418013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 151/316] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:40.423466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:40.482553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:40.534180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83d5b-e155-4cc2-9404-9a410b701100 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:40.575379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62714ef6-db1d-4fcf-908b-e3797ba315e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:40.576286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714ef6-db1d-4fcf-908b-e3797ba315e8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:40.576568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714ef6-db1d-4fcf-908b-e3797ba315e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:40.576844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714ef6-db1d-4fcf-908b-e3797ba315e8 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:40.578514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62714ef6-db1d-4fcf-908b-e3797ba315e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:40.581186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62714ef6-db1d-4fcf-908b-e3797ba315e8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:40.583825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 166/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:40 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:40.599175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:40.672027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:40.704044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d538-2e07-4afd-90dc-bb492e3edc3a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:40.741514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:40.742184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:40.742470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:40.742749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:40.743585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] RBAC: Adding query filter params (role.id=bb69314e349248aa8762ba2dfc9f71ea, scope.project.id=e2ee3d16251f43b7837010500151c1f2, user.id=5abec22583ca4971a5c9bd0901e877f5) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:40.743924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:40.745364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ceb9-858e-439d-b126-40b083a16ceb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:40.751863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 152/318] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:22:40 2022] GET /identity/v3/role_assignments?user.id=5abec22583ca4971a5c9bd0901e877f5&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=bb69314e349248aa8762ba2dfc9f71ea => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:41.181934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298ae2b-de0c-4846-aa88-6ffbea6d9bea None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.182450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298ae2b-de0c-4846-aa88-6ffbea6d9bea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.182522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298ae2b-de0c-4846-aa88-6ffbea6d9bea None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.184067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 167/319] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:41.189157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.189450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.189726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.206233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:41.207945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:41.277915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 153/320] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:41.300020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298ae2b-de0c-4846-aa88-6ffbea6d9bea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:41.408868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298ae2b-de0c-4846-aa88-6ffbea6d9bea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:41.435534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:41.450280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059489d3-9cad-4f6e-b47b-1725fe7b40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:41.451090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059489d3-9cad-4f6e-b47b-1725fe7b40b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.451372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059489d3-9cad-4f6e-b47b-1725fe7b40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.451646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059489d3-9cad-4f6e-b47b-1725fe7b40b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.452930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059489d3-9cad-4f6e-b47b-1725fe7b40b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:41.454377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059489d3-9cad-4f6e-b47b-1725fe7b40b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:41.456251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 168/321] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:22:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:41.462228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:41.532197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:41.568884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e699-d09e-48c1-91ec-1c1410757646 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:41.611878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e590c-d5a0-459f-8bca-2f452d760315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:41.612569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e590c-d5a0-459f-8bca-2f452d760315 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.612850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e590c-d5a0-459f-8bca-2f452d760315 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.613122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e590c-d5a0-459f-8bca-2f452d760315 None admin] PATH_INFO: `/v3/groups` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.613848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e590c-d5a0-459f-8bca-2f452d760315 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:41.615285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e590c-d5a0-459f-8bca-2f452d760315 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:41.632543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 154/322] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Jul 20 09:22:41 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:22:41.674679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60747050-4a53-4ea1-b4d9-08e547b2b13c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.675130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60747050-4a53-4ea1-b4d9-08e547b2b13c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.675509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60747050-4a53-4ea1-b4d9-08e547b2b13c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.677224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 169/323] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:41.683151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d98f51-9d47-412f-ace0-4c2cd54893af None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.683745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d98f51-9d47-412f-ace0-4c2cd54893af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.683826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d98f51-9d47-412f-ace0-4c2cd54893af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.702338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-51d98f51-9d47-412f-ace0-4c2cd54893af None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:41.703486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-51d98f51-9d47-412f-ace0-4c2cd54893af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:41.779785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 155/324] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:41.802885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60747050-4a53-4ea1-b4d9-08e547b2b13c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:41.916646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60747050-4a53-4ea1-b4d9-08e547b2b13c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:41.935380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf5173-7a27-49b0-91ac-b82c08e1bdbb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.935909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf5173-7a27-49b0-91ac-b82c08e1bdbb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.936285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf5173-7a27-49b0-91ac-b82c08e1bdbb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.938045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 156/325] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:41.943668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.943991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.944273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.962254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:41.963741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:41.968500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:41.969340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:41.969625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:41.969902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:41.981818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:41.990374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:41.991257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:41.992040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 170/326] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:41.998352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.036855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:42.054865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 157/327] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:42.066067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:42.078430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.127268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2532-cddb-41cd-82b3-b0d6df778644 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.175995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.177054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.177520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.177971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.178904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:42.179435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:42.181047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:42.190572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 171/328] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:42.196383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.204804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355594c0-3d3a-42a0-a7e5-f88c4032a854 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.266276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.267017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.267297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.267564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.281421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:42.290014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:42.290906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:42.291728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:42.296852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 158/329] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:42.297609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.322791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1229f-fef0-4c79-b65d-1b1b5b19a83e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.338670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:42.351805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:42.365632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.366980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.367458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.367949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] PATH_INFO: `/v3/users/7e644560bcda4b648230222f20ed0072` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.369548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] RBAC: Authorizing `identity:get_user(user_id=7e644560bcda4b648230222f20ed0072)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:42.371181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:42.373590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 172/330] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:42 2022] GET /identity/v3/users/7e644560bcda4b648230222f20ed0072 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:42.379967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.414264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bcda-e8ce-4235-8d9b-2972c94ec32c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.457244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.458346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.458630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.458912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.459843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:42.460045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:42.463708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:42.479617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 159/331] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:42.480994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.518109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9148f-478c-4ef0-bee2-ac9134f1a346 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.566302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.567568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.568071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.568542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] PATH_INFO: `/v3/system/users/7e644560bcda4b648230222f20ed0072/roles/bb69314e349248aa8762ba2dfc9f71ea` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.571024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e644560bcda4b648230222f20ed0072, role_id=bb69314e349248aa8762ba2dfc9f71ea)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:42.573488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:42.590326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 173/332] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 20 09:22:42 2022] PUT /identity/v3/system/users/7e644560bcda4b648230222f20ed0072/roles/bb69314e349248aa8762ba2dfc9f71ea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:42.603564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944b0ac-5aae-48fa-a7a4-aa7fc802f1e5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.614698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:42.649858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c9282-596d-48c5-af45-0d9b2360b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.651174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c9282-596d-48c5-af45-0d9b2360b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.651656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c9282-596d-48c5-af45-0d9b2360b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.652150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c9282-596d-48c5-af45-0d9b2360b6cd None admin] PATH_INFO: `/v3/users/4a100a6f0ef94ec295d9d034023132d5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.653552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c9282-596d-48c5-af45-0d9b2360b6cd None admin] RBAC: Authorizing `identity:get_user(user_id=4a100a6f0ef94ec295d9d034023132d5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:42.655203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c9282-596d-48c5-af45-0d9b2360b6cd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:42.657434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 160/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:42 2022] GET /identity/v3/users/4a100a6f0ef94ec295d9d034023132d5 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:42.664063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:42.719919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:42.783813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad0bb-9824-4229-9aaa-93dab6c7238a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:42.820307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:42.821380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:42.821860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:42.822334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:42.823381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] RBAC: Adding query filter params (role.id=30419c28dd3c4881a47b462c6717a79e, user.id=4a100a6f0ef94ec295d9d034023132d5, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:42.823922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:42.825717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc697cb-fb33-45c4-a3e0-c1e140c8d569 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:42.841270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 174/334] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 20 09:22:42 2022] GET /identity/v3/role_assignments?user.id=4a100a6f0ef94ec295d9d034023132d5&scope.system=all&role.id=30419c28dd3c4881a47b462c6717a79e => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:44.031950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9e31-da5a-473d-bf2f-9a711bba2c80 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:44.032976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9e31-da5a-473d-bf2f-9a711bba2c80 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:44.033459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9e31-da5a-473d-bf2f-9a711bba2c80 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:44.035318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 161/335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:44.042132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:44.042974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:44.043449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:44.065296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:44.067439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:44.143279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 175/336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:44.168553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef9e31-da5a-473d-bf2f-9a711bba2c80 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:44.287964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef9e31-da5a-473d-bf2f-9a711bba2c80 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:44.328242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:44.329391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:44.329868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:44.330337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:44.348676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:44.357446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:44.358300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:44.359055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:44.361788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 162/337] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:44.368091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:44.420468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:44.510622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e3f6-85e9-437b-8227-d3e6872555ae None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:44.560427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:44.561126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:44.561414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:44.561696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:44.562454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:44.562762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:44.564182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:44.573665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 176/338] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:44.579473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:44.629529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:44.709007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f27e2-e85d-4436-8962-87a1854fd396 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:44.751007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0efc7-6187-4a67-a143-6c50a1ed70c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:44.752067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0efc7-6187-4a67-a143-6c50a1ed70c7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:44.752581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0efc7-6187-4a67-a143-6c50a1ed70c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:44.753066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0efc7-6187-4a67-a143-6c50a1ed70c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:44.845688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0efc7-6187-4a67-a143-6c50a1ed70c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:44.847148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0efc7-6187-4a67-a143-6c50a1ed70c7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:44.888451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:44.976287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 163/339] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:44.982174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.138866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:45.145562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cd44c-80e7-4f03-bbe2-8ed58d1c2ac9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.155923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d875e-4601-44e5-a3bf-45d49ff4413c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.156879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d875e-4601-44e5-a3bf-45d49ff4413c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.157373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d875e-4601-44e5-a3bf-45d49ff4413c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.158956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 164/340] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:45.164299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.165006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.165476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.195863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:45.197538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:45.211742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:45.211742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.211742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.212071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.213337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:45.215070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:45.217954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 177/341] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:44 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:45.222447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.291195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 165/342] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:45.329690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.424149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:45.444200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f093-a29b-401a-8f2e-9735847c2301 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.473251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054aefb-2482-406b-b494-8b4affcde4db None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.491084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a4163-d760-4b73-b514-33528cf04db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:45.492494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4163-d760-4b73-b514-33528cf04db8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.493003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4163-d760-4b73-b514-33528cf04db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.493484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a4163-d760-4b73-b514-33528cf04db8 None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.502846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a4163-d760-4b73-b514-33528cf04db8 None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:45.505381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a4163-d760-4b73-b514-33528cf04db8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:45.512192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 178/343] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:45 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:45.513760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74533a38-58be-4bbb-aa19-9606cd565fb0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.514162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74533a38-58be-4bbb-aa19-9606cd565fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.514475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74533a38-58be-4bbb-aa19-9606cd565fb0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.516090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad6989-ccf8-42a8-b3fd-2f7e182480a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:45.516280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 179/344] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:45.516994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad6989-ccf8-42a8-b3fd-2f7e182480a1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.517278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad6989-ccf8-42a8-b3fd-2f7e182480a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.517555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad6989-ccf8-42a8-b3fd-2f7e182480a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.517850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74533a38-58be-4bbb-aa19-9606cd565fb0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.530685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad6989-ccf8-42a8-b3fd-2f7e182480a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-61ad6989-ccf8-42a8-b3fd-2f7e182480a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:45.540369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:45.541530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:45.542500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:45.544867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 166/345] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:45.546383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.546911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.547324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.565605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:45.567053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:45.575980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:45.645847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 167/346] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:45.647026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.715377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:45.717443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74533a38-58be-4bbb-aa19-9606cd565fb0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.766145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c199c-036a-4efa-99ae-c2fc51ce018d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.781468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:45.782488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.782958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.783418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.784473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=16f5cac40dc546bd88833a590e407004) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:45.784970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:45.787186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:45.798013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 180/347] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:45 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=30419c28dd3c4881a47b462c6717a79e => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:45.799094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.806051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:45.806880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.807166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.807443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:45.808356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:45.808832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:45.810393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:45.820281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 168/348] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:45.835321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:45.922631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:45.938225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da01c67-9632-44af-a7df-31e23d895b99 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.984173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f2c92-54c4-4104-8b51-faa36499f2aa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:45.992199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:45.993167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:45.993556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:45.993936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.013924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:46.016628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:46.028509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:46.029459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:46.030237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:46.033068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 181/349] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:46.040104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.059325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05fb47-6d9d-4695-8d59-237f2a87e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:46.060412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fb47-6d9d-4695-8d59-237f2a87e9cf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.060913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fb47-6d9d-4695-8d59-237f2a87e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.061383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fb47-6d9d-4695-8d59-237f2a87e9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.175325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05fb47-6d9d-4695-8d59-237f2a87e9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:46.178433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05fb47-6d9d-4695-8d59-237f2a87e9cf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:46.220136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae1aae-9d8d-44a8-8661-ebf4bb3187c9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:46.258984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:46.260005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.260430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.260848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.261762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:46.262227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:46.264997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576d136-9712-471c-9fa8-794f7a622678 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:46.274221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 182/350] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:46.275886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dcda9-5da3-4ad1-a372-1bcf2903f49c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.276374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dcda9-5da3-4ad1-a372-1bcf2903f49c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.276824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dcda9-5da3-4ad1-a372-1bcf2903f49c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.278547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 183/351] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:46.279433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dcda9-5da3-4ad1-a372-1bcf2903f49c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.296803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:46.360191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 169/352] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:46.361925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.362426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.362888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.390101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dcda9-5da3-4ad1-a372-1bcf2903f49c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:46.396755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:46.398452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:46.420721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:46.426915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b0186-3132-477a-8e27-d705f6fa22b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:46.428194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b0186-3132-477a-8e27-d705f6fa22b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.428673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b0186-3132-477a-8e27-d705f6fa22b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.429179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b0186-3132-477a-8e27-d705f6fa22b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.501007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b0186-3132-477a-8e27-d705f6fa22b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:46.502728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b0186-3132-477a-8e27-d705f6fa22b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:46.515260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 170/353] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:46.516338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.519129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:46.618060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 184/354] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:46.624815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0830c4-7950-4dbc-bc64-fa95f89dcb68 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.625140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0830c4-7950-4dbc-bc64-fa95f89dcb68 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.625430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0830c4-7950-4dbc-bc64-fa95f89dcb68 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.630921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 185/355] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:46.630921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0830c4-7950-4dbc-bc64-fa95f89dcb68 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.669019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359cd52-c753-448e-9792-c423e1bc1a15 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:46.712478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:46.713361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.713644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.713920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.716124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:46.717596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:46.719528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 171/356] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:46.720132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.745316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:46.787606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0830c4-7950-4dbc-bc64-fa95f89dcb68 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:46.807302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:46.833911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1b12c-f8eb-41de-9d43-8ca52d67eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:46.835004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b12c-f8eb-41de-9d43-8ca52d67eae7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.835478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b12c-f8eb-41de-9d43-8ca52d67eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.836031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1b12c-f8eb-41de-9d43-8ca52d67eae7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.848642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1b12c-f8eb-41de-9d43-8ca52d67eae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:46.854004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17537d-b79a-44c7-afe7-60c1938545e1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c6f1b12c-f8eb-41de-9d43-8ca52d67eae7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:46.857806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:46.858760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:46.859574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:46.862505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 186/357] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:46.865377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.865912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.866403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.887876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:46.889822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:46.898805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:46.899691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:46.899998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:46.900269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:46.901479 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:46.902913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:46.904949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 172/358] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:46.905721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.964773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 187/359] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:46.965940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:46.999992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.024457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e01490-2eae-4c9b-a43e-cc0806a18eac None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.074128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e45e63-5d8a-49fd-8ac5-6374d176c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.075003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e45e63-5d8a-49fd-8ac5-6374d176c94f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.075287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e45e63-5d8a-49fd-8ac5-6374d176c94f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.075554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e45e63-5d8a-49fd-8ac5-6374d176c94f None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.076788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e45e63-5d8a-49fd-8ac5-6374d176c94f None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.078240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e45e63-5d8a-49fd-8ac5-6374d176c94f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.079954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 173/360] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:47.081147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2958e-73c0-4153-b8cd-5ecbb73c40d5 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.081434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2958e-73c0-4153-b8cd-5ecbb73c40d5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.081705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2958e-73c0-4153-b8cd-5ecbb73c40d5 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.083587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 174/361] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:47.084209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2958e-73c0-4153-b8cd-5ecbb73c40d5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.097024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9c2ac-b402-4c0e-8d3f-292f85a943c1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.103218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.147813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.148452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.148736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.149012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.149763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:47.150069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.151460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.162851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 188/362] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:47.164152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.229969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2958e-73c0-4153-b8cd-5ecbb73c40d5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.276609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.278249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.278249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.278249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.279503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.281057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.283141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 175/363] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:47.284294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.294980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69d64-fa28-4c13-a06a-170a8ed28edf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.312531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.343390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119bc71-9b7d-4d68-aed0-f8a56afd053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.344344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119bc71-9b7d-4d68-aed0-f8a56afd053c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.344687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119bc71-9b7d-4d68-aed0-f8a56afd053c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.344968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119bc71-9b7d-4d68-aed0-f8a56afd053c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.362334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119bc71-9b7d-4d68-aed0-f8a56afd053c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c119bc71-9b7d-4d68-aed0-f8a56afd053c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:47.378507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:47.379543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 189/364] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:47.380373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.381434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.381434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.402255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:47.403761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:47.435760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.437773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fe2bb-537e-418f-bae3-2dd5ccfe8160 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.484555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.485710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.486441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.486721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.487560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=16f5cac40dc546bd88833a590e407004) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:47.487914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.490040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.498156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 176/365] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:47.498794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.507822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 190/366] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:47.508713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.638130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a72d0-0e8d-4fb3-8435-d474b3373336 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.647241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.665214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822903-a13b-4ff1-b38f-f40f16280cf1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.683626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.684340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.684624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.684900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.685753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=e2ee3d16251f43b7837010500151c1f2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:47.686066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.687525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.694256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 191/367] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=30419c28dd3c4881a47b462c6717a79e => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:47.695116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.710976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.712007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.712710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.713175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.725903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.843900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.846977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.854609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bd5d4-720e-4570-96d4-b35d706792dc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:47.914876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:47.915629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:47.915877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:47.916204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:47.916982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:47.917293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:47.918928 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:47.937792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 192/368] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:47.943343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:47.999893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.026416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 177/369] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:48.030542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.086393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.116631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7575-42ed-42de-8350-e0177b889771 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.217406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.219074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.219361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.219640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.233109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ac98-8c44-48ce-bf90-883ce2dc5860 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.252713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:48.261164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:48.262037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:48.263057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 193/370] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:48.263688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.275372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.276266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.276604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.276886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] PATH_INFO: `/v3/users/7e644560bcda4b648230222f20ed0072` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.278599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] RBAC: Authorizing `identity:get_user(user_id=7e644560bcda4b648230222f20ed0072)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.279578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.281428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 178/371] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/users/7e644560bcda4b648230222f20ed0072 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:48.282121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.346960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.391451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f76b6-2e05-4c29-8051-583aae7d9799 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.401950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6f805-b71e-4b3e-8391-77f2ebb89af2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.429566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.430468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.430747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.431017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.432252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.433709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.435778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 194/372] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:48.436641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.439894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.440686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.440972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.441244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.442548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:48.442861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.444355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebc663-7117-438c-bebe-74e16da80b0b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.458739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 179/373] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:48.460261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98235-ef2b-47a6-9090-4c393304bbf8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.460555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98235-ef2b-47a6-9090-4c393304bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.460835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98235-ef2b-47a6-9090-4c393304bbf8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.462150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 180/374] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:48.464029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac98235-ef2b-47a6-9090-4c393304bbf8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.464162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.550457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7642-28f4-4733-a2d5-a908bf183eef None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.595808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac98235-ef2b-47a6-9090-4c393304bbf8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.597350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.599202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.599694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.600199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.601229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] RBAC: Adding query filter params (role.id=bb69314e349248aa8762ba2dfc9f71ea, user.id=7e644560bcda4b648230222f20ed0072, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:48.601736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.603374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.615370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.622713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 195/375] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/role_assignments?user.id=7e644560bcda4b648230222f20ed0072&scope.system=all&role.id=bb69314e349248aa8762ba2dfc9f71ea => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:48.624293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.644330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1d86-e383-49b8-824a-256522556ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.646205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1d86-e383-49b8-824a-256522556ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.646205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1d86-e383-49b8-824a-256522556ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.646205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1d86-e383-49b8-824a-256522556ea0 None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.647564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1d86-e383-49b8-824a-256522556ea0 None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.649163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1d86-e383-49b8-824a-256522556ea0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.651125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 181/376] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:48.653743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.653743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.653743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.672972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:48.674201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:48.739059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.765789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 182/377] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:48.767023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:48.773311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bdc29-9dd9-4af4-b6ca-468c603262f7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.837830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.838498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.838787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.839068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.915260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a37ac-000d-48e4-a0fc-c111c9be395b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:48.930796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:48.936755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.938811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.958280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:48.959605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:48.960114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:48.960788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:48.962266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=e2ee3d16251f43b7837010500151c1f2) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:48.962775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:48.964443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:48.973662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 183/378] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:48.975334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.022091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:49.083065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 196/379] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:49.109219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.119410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40f28-84b2-4626-8f8c-ba82a32db6c7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.162652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.164023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.164456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.165366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.179585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:49.189196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:49.190323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:49.191881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:49.194310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 184/380] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:49.203365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.247017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:49.318877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3a7d4-2355-4b27-98d2-1f895b8094c2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.334352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70510f3-8a9b-468b-8f6b-54f41aca78ec None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.373391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.374268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.374550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.374825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] PATH_INFO: `/v3/projects/6c023b716ed04429bdfefdcd2624fe52` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.376725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] RBAC: Authorizing `identity:get_project(project_id=6c023b716ed04429bdfefdcd2624fe52)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:49.378195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:49.380045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 197/381] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:49 2022] GET /identity/v3/projects/6c023b716ed04429bdfefdcd2624fe52 => generated 344 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:49.385874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.401067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.401753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.402035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.402308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.403070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:49.403381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:49.404802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:49.419705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 185/382] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:49.427967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.462668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:49.599139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec8e7-84c5-431c-a24b-92cab3490add None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.601730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:49.613018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702a552-7d64-473d-9fa4-fff7e1f4ebee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.645254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.646133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.646416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.646689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.648045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:49.650950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:49.656843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 186/383] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:49 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:49.664234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.693242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.694175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.694462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.694742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] PATH_INFO: `/v3/groups/e35eba1f77a44529b288000c20f30eeb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.708565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] RBAC: Authorizing `identity:get_group(group_id=e35eba1f77a44529b288000c20f30eeb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:49.710037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:49.711859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 198/384] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:49 2022] GET /identity/v3/groups/e35eba1f77a44529b288000c20f30eeb => generated 229 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:49.717689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.852970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:49.862756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1795-7f5b-45a5-a737-e44c3d46272d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.867020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3169e6a-026f-4693-9edd-47b136bb7d39 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:49.912544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.913786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.914077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.914356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.915872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:49.917329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:49.919069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 187/385] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:49 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:49.924705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:49.925401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:49.925762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:49.926550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:49.927487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] RBAC: Adding query filter params (group.id=e35eba1f77a44529b288000c20f30eeb, role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=6c023b716ed04429bdfefdcd2624fe52) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:49.927882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:49.929389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e145-4e5d-4c43-8cc0-438ca74bc956 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:49.931252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:49.947607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 199/386] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:49 2022] GET /identity/v3/role_assignments?group.id=e35eba1f77a44529b288000c20f30eeb&scope.project.id=6c023b716ed04429bdfefdcd2624fe52&role.id=2e997984fe364ad8afd717716e701a23 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:49.996196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:50.057882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb912-930e-4ab0-9447-120070809587 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:50.095958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ddf94-9377-48dd-9917-4f76e458e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:50.096868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ddf94-9377-48dd-9917-4f76e458e064 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.097157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ddf94-9377-48dd-9917-4f76e458e064 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.097435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ddf94-9377-48dd-9917-4f76e458e064 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004/groups/b614c82257f245d589fb3f03b76ac6c2/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.099567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ddf94-9377-48dd-9917-4f76e458e064 None admin] RBAC: Authorizing `identity:create_grant(project_id=16f5cac40dc546bd88833a590e407004, group_id=b614c82257f245d589fb3f03b76ac6c2, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:50.101074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ddf94-9377-48dd-9917-4f76e458e064 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:50.120315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 188/387] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 20 09:22:49 2022] PUT /identity/v3/projects/16f5cac40dc546bd88833a590e407004/groups/b614c82257f245d589fb3f03b76ac6c2/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:50.318723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7be6f-54bd-411f-b02f-f3f7d48dc412 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.319087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7be6f-54bd-411f-b02f-f3f7d48dc412 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.319393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7be6f-54bd-411f-b02f-f3f7d48dc412 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.321030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 200/388] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:50.326478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c29bb-29d4-4281-af5e-c9efb5ec4ef0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.327351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c29bb-29d4-4281-af5e-c9efb5ec4ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.327857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c29bb-29d4-4281-af5e-c9efb5ec4ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.348642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2f3c29bb-29d4-4281-af5e-c9efb5ec4ef0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:50.350164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2f3c29bb-29d4-4281-af5e-c9efb5ec4ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:50.425198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 189/389] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:50.449998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7be6f-54bd-411f-b02f-f3f7d48dc412 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:50.579009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7be6f-54bd-411f-b02f-f3f7d48dc412 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:50.610993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385930e-076a-42fb-b9d3-8ec6e5d741e6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.611633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385930e-076a-42fb-b9d3-8ec6e5d741e6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.612165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385930e-076a-42fb-b9d3-8ec6e5d741e6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.614118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 190/390] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:50.625696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.625995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.626209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:50.626352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.627362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.627922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.628399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.650954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:50.659617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:50.661089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:50.661957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:50.669046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:50.670513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:50.673914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 201/391] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:50.680223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:50.708921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:50.710041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:50.795342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050849a-8f2d-4c82-b8ec-6c16857caeb8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:50.842130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:50.843187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:50.843674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:50.844198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:50.845158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:50.845681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:50.847279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:50.856347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 202/392] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:50.864002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:50.869421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 191/393] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:50.906718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:50.965342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:50.977600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd40ac-4e73-470a-aeaf-9efff935604d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.014319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.015614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.016133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.016636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.018038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.020423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:51.022589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 203/394] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:50 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:51.029112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:51.094164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32249-8548-43ae-99f8-bb048352a5ab None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.136845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059836-a824-4968-bc7f-b6eb3a45aa55 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.153423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.154540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.154955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.155405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.176497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.177722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.178211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.178708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.180208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.181436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:51.182220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:51.184515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 204/395] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:51 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:51.189255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:51.190298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:51.191816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:51.193228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:51.194269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 192/396] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:51.199884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:51.220944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:51.226065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:51.333172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f918d45-0773-498c-99c2-f8b2d894db52 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.335115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ed66-08d5-4e79-b2aa-980dff613d68 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.370727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.371705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.372189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.372662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.373688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:51.374228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.375778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:51.385732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 193/397] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:51.393950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:51.396687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.397600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.398110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.398262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004/groups/b614c82257f245d589fb3f03b76ac6c2/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.405692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=16f5cac40dc546bd88833a590e407004, group_id=b614c82257f245d589fb3f03b76ac6c2, role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.407277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:51.432970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 205/398] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 20 09:22:51 2022] PUT /identity/v3/projects/16f5cac40dc546bd88833a590e407004/groups/b614c82257f245d589fb3f03b76ac6c2/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:51.482338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:51.514462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381aabc-39a2-4c59-a5ad-1d0976585d24 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.555663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.556580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.556868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.557147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.558452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.559961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:51.561890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 194/399] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:51 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:51.568053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:51.707015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:51.728469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296bd9-3f39-4ce5-91fe-91b3c01a8e38 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.768477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a925d-68af-48a7-bb4d-3eb30da41f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.769276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a925d-68af-48a7-bb4d-3eb30da41f97 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.770136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a925d-68af-48a7-bb4d-3eb30da41f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.770418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a925d-68af-48a7-bb4d-3eb30da41f97 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.773003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a925d-68af-48a7-bb4d-3eb30da41f97 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.774516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a925d-68af-48a7-bb4d-3eb30da41f97 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:51.781151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 206/400] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:51 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:51.782486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:51.929099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaf389-6bcc-4bd2-819b-6f31915d10f4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:51.983254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf4129-09e6-4fd9-8d58-d4594e43f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:51.984178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4129-09e6-4fd9-8d58-d4594e43f91b None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:51.984462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4129-09e6-4fd9-8d58-d4594e43f91b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:51.984738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4129-09e6-4fd9-8d58-d4594e43f91b None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2/groups/b614c82257f245d589fb3f03b76ac6c2/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:51.993043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf4129-09e6-4fd9-8d58-d4594e43f91b None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee3d16251f43b7837010500151c1f2, group_id=b614c82257f245d589fb3f03b76ac6c2, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:51.994501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf4129-09e6-4fd9-8d58-d4594e43f91b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:52.016441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 195/401] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 20 09:22:51 2022] PUT /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2/groups/b614c82257f245d589fb3f03b76ac6c2/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:22:52.031996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d05e-c25c-4f9f-b492-3a0bc29f7c05 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.032290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d05e-c25c-4f9f-b492-3a0bc29f7c05 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.032482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d05e-c25c-4f9f-b492-3a0bc29f7c05 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.033892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 207/402] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:52.040122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.040410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.040687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.047190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:52.059649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:52.065327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:52.173036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 196/403] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:52.201930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d05e-c25c-4f9f-b492-3a0bc29f7c05 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:52.326088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d05e-c25c-4f9f-b492-3a0bc29f7c05 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:52.365374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:52.366194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.366479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.366755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.381078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:52.389786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:52.390893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:52.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 208/404] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:52.399533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:52.554647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09e612-30cb-45b4-b612-d06bc8384163 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:52.602899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:52.603498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.603814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.604090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.604848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:52.605157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:52.606520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8118ab-90cf-4386-b25e-060ad929063e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:52.608013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:52.619053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 197/405] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:52.624896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:52.656080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:52.798387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877ab3a-5a2f-4d74-ab0b-51cabea9e832 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:52.857967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:52.858766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.859051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.859330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.860878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:52.861297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ac4b9-6e6c-44c7-8270-bd5f6a92839c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.861590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ac4b9-6e6c-44c7-8270-bd5f6a92839c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.861864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ac4b9-6e6c-44c7-8270-bd5f6a92839c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.862327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:52.863606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 198/406] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:52.864313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 209/407] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:52 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:52.868774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:52.869058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:52.869332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:52.869505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:52.900432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:52.901643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:52.998929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 199/408] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:53.024551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.028079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.098594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c6a6-35e0-4a5e-86b4-cd93570b456c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.129151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f76c-1e16-45b9-990f-246950f0b601 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.135692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab72781-8c00-4aaf-951c-dd8d928694e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.136596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72781-8c00-4aaf-951c-dd8d928694e5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.136984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72781-8c00-4aaf-951c-dd8d928694e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.137266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72781-8c00-4aaf-951c-dd8d928694e5 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.138734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab72781-8c00-4aaf-951c-dd8d928694e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:53.140350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab72781-8c00-4aaf-951c-dd8d928694e5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:53.147443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 210/409] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:52 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:53.148887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21310-1e01-472f-9549-a531c5eb4bd6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.149178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21310-1e01-472f-9549-a531c5eb4bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.149459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21310-1e01-472f-9549-a531c5eb4bd6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.151040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 211/410] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:53.151978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21310-1e01-472f-9549-a531c5eb4bd6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.156952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.166789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d25d91-278a-4190-bbcd-a043df396ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.167598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25d91-278a-4190-bbcd-a043df396ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.167916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25d91-278a-4190-bbcd-a043df396ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.168244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25d91-278a-4190-bbcd-a043df396ca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.180605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d25d91-278a-4190-bbcd-a043df396ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-83d25d91-278a-4190-bbcd-a043df396ca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:53.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:53.189685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:53.190470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:53.193151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 200/411] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:53.194643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.195104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.195530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.212867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:53.214307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:53.282658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21310-1e01-472f-9549-a531c5eb4bd6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.291747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 201/412] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:53.291747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.342572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.343794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.344285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.344758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2/groups/b614c82257f245d589fb3f03b76ac6c2/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.347558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee3d16251f43b7837010500151c1f2, group_id=b614c82257f245d589fb3f03b76ac6c2, role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:53.349501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:53.372156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 212/413] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 20 09:22:53 2022] PUT /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2/groups/b614c82257f245d589fb3f03b76ac6c2/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:22:53.373561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.390857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.397605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791626b8-ba69-4c05-ad35-08b660a5dc6c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.420047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.443609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.444427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.444723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.445004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.445898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:53.446215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:53.447894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:53.457564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 202/414] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:53.464615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.536994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1f7ef-3ba5-4cc3-bab0-9ee332685388 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.579592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7cb3-8ac2-4825-b4c5-7930afb0fd9e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.618113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.619065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.619356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.619679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] PATH_INFO: `/v3/groups/e35eba1f77a44529b288000c20f30eeb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.621163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] RBAC: Authorizing `identity:get_group(group_id=e35eba1f77a44529b288000c20f30eeb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:53.622634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:53.624455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 203/415] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/groups/e35eba1f77a44529b288000c20f30eeb => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:53.625152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.625986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.626271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.626549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.630912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.658336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:53.666840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:53.670392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:53.671233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 213/416] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:53.680241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.689859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.751268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518f148-bb42-481a-a3aa-e0766c844d91 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.761341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.792119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.794353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.794771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.795054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] PATH_INFO: `/v3/projects/6c023b716ed04429bdfefdcd2624fe52` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.796411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=6c023b716ed04429bdfefdcd2624fe52)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:53.797871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:53.800122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 204/417] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/projects/6c023b716ed04429bdfefdcd2624fe52 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:53.802829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2cd0f-1b45-4db9-8e0a-519698848a35 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.819581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.885705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.886561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.886950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.887350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.889014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:53.889014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:53.890413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:53.914376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 214/418] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:53.920060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:53.950728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe457b7-4a4a-466b-b4d0-4e6b32656ad3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:53.967446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:53.994241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe233f1-689b-4825-807d-f48548f7707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:53.995470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe233f1-689b-4825-807d-f48548f7707b None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:53.996191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe233f1-689b-4825-807d-f48548f7707b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:53.996657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe233f1-689b-4825-807d-f48548f7707b None admin] PATH_INFO: `/v3/projects/6c023b716ed04429bdfefdcd2624fe52/groups/e35eba1f77a44529b288000c20f30eeb/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:53.999523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe233f1-689b-4825-807d-f48548f7707b None admin] RBAC: Authorizing `identity:create_grant(project_id=6c023b716ed04429bdfefdcd2624fe52, group_id=e35eba1f77a44529b288000c20f30eeb, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:54.001335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe233f1-689b-4825-807d-f48548f7707b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:54.019831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 205/419] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 20 09:22:53 2022] PUT /identity/v3/projects/6c023b716ed04429bdfefdcd2624fe52/groups/e35eba1f77a44529b288000c20f30eeb/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:22:54.029375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7babe-afc9-4d34-b391-0f414830013e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.029950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7babe-afc9-4d34-b391-0f414830013e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.030489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7babe-afc9-4d34-b391-0f414830013e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.032386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 206/420] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:54.045262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.045871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.046330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.080755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:54.082807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:54.103741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bad7e-2452-4d9f-879f-93756311d2b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:54.132033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:54.150394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:54.151363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.151935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.152400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.192036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 207/421] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:54.216741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:54.292204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:54.293699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:54.332799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500c065-4bde-4f21-b1a6-a40b218d66bf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:54.335204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:54.373097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:54.373926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.374210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.374489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.387489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:54.396593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:54.397490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:54.398308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 208/422] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:54.404635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:54.413312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 215/423] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:54.420660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:54.482934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:54.567638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ce882-04eb-45bc-b054-58fb4da526b6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:54.590377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48e50-9049-48a8-ae68-c773bb95c003 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:54.611647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:54.611647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.611647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.611647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.612056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:54.612056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:54.612056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759909c9-012f-4a68-a0af-3dd04d7c2e05 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:54.621184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 209/424] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:54.627165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261fc1-7ee5-472c-bd8a-a3850f350d58 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.627466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261fc1-7ee5-472c-bd8a-a3850f350d58 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.627927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261fc1-7ee5-472c-bd8a-a3850f350d58 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.630643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 210/425] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:54.631304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86b38-ce90-4339-b7f4-028d8606df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:54.631443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261fc1-7ee5-472c-bd8a-a3850f350d58 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:54.632504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86b38-ce90-4339-b7f4-028d8606df5f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.632890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86b38-ce90-4339-b7f4-028d8606df5f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.633285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86b38-ce90-4339-b7f4-028d8606df5f None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.634899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86b38-ce90-4339-b7f4-028d8606df5f None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:54.637283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86b38-ce90-4339-b7f4-028d8606df5f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:54.643667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 216/426] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:54.643667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.643667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.643667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.668727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:54.669953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:54.671651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:54.752871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261fc1-7ee5-472c-bd8a-a3850f350d58 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:54.764666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 217/427] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:54.766362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:54.793432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:54.793946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.794238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.797662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.798586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:54.873518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:54.875076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:54.876356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a9ba4-af9a-4a34-a01b-459ad2fa0adb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:54.905202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:54.913204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:54.914338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:54.914816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:54.915283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:54.917249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:54.918941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:54.920819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 218/428] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:54.926582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:54.993991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 211/429] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:54.999401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.026707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:55.033927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041615e-3559-4e89-96ff-c25bc9480f3e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.069767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.070980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.071478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.072014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.083861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:55.091994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:55.092840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 09:22:55.093594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:22:55.096241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 219/430] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:55.097986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.110303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9a6a-57ac-4417-9bc4-b8d0790661f9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.140125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:55.148889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.149797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.150200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.150580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.151618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=16f5cac40dc546bd88833a590e407004) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:55.152063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.153694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.160778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 212/431] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:54 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=30419c28dd3c4881a47b462c6717a79e => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:55.167927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.274624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c590-2e28-48a7-8f03-0d6d01de5e79 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.289870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695682ab-e04f-42c6-bfa9-910efcd67f0f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.313074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.313871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.314396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.314754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.315604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:55.316016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.317683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.328086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 213/432] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:55.335006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.370950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.371913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.372242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.372523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] PATH_INFO: `/v3/projects/16f5cac40dc546bd88833a590e407004` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.373729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] RBAC: Authorizing `identity:get_project(project_id=16f5cac40dc546bd88833a590e407004)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.375202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.382696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 220/433] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/projects/16f5cac40dc546bd88833a590e407004 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:55.384090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.406613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:55.420876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:55.471384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aff7ef-9fd2-4230-97ce-5f412b26cc79 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.509008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.509816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.510111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.510391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.522671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f517a0-014a-468a-b35b-4252b703dec4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.563473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.564727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.565206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.565778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.569122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.570864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.573204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 221/434] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:55.580877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.592564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.595063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.668966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:55.689261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:55.703802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda37fc4-fa7a-4eae-b426-63d904b3576b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.729602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 214/435] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:55.734809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.748598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.749527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.750366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.750791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.752101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=16f5cac40dc546bd88833a590e407004) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:55.752559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.756423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.765279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 222/436] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=16f5cac40dc546bd88833a590e407004&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:55.853852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf192fd-7003-49cd-9670-9aa18bf09283 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:55.899852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660109f-ccf7-43f4-aa0f-795ceaffee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:55.900821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660109f-ccf7-43f4-aa0f-795ceaffee1d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.901102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660109f-ccf7-43f4-aa0f-795ceaffee1d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.901373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660109f-ccf7-43f4-aa0f-795ceaffee1d None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.903120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660109f-ccf7-43f4-aa0f-795ceaffee1d None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:55.904640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660109f-ccf7-43f4-aa0f-795ceaffee1d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:55.906790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 215/437] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:55.912698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:55.990747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49152b-1bcd-4c84-be5c-c1487eb3111b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.991091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49152b-1bcd-4c84-be5c-c1487eb3111b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:55.991291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49152b-1bcd-4c84-be5c-c1487eb3111b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:55.992698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 216/438] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:22:55.999383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:55.999679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.000053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.032028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:56.033235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:56.033778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca65d9e-6e8d-432c-bbf6-7a3eb9c6f218 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.062691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.075354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.076270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.076985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.076985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.079290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:56.080768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:56.083985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 223/439] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:55 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:56.089122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.119641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.126653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 217/440] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:56.152694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.218373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2fe23-5030-4e97-889e-30970d6163ee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.264589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.265266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.265662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.265938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.266777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=30419c28dd3c4881a47b462c6717a79e, scope.project.id=e2ee3d16251f43b7837010500151c1f2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:56.267085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:56.268746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:56.276730 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 224/441] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=30419c28dd3c4881a47b462c6717a79e => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:56.297662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55dc43-af7c-4e6c-9bf2-126d9ee9cb6c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.344282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7115c-acab-46cb-996b-91037b713c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.345043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7115c-acab-46cb-996b-91037b713c90 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.345326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7115c-acab-46cb-996b-91037b713c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.345604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7115c-acab-46cb-996b-91037b713c90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.360704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7115c-acab-46cb-996b-91037b713c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-f6d7115c-acab-46cb-996b-91037b713c90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:56.369385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:56.370321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:56.371200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 218/442] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:22:56.376836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.405173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1de7b-32b2-4300-b408-9fc3dcc1dc83 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.405533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1de7b-32b2-4300-b408-9fc3dcc1dc83 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.405731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1de7b-32b2-4300-b408-9fc3dcc1dc83 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.407429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 219/443] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:22:56.414467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.414780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.415027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.432673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:22:56.433895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:22:56.438043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.492013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.511159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd2cdd-d366-4574-b2bc-d6929e9562c0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.516429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 220/444] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:22:56.540776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.553052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.553738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.554047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.554318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.555072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:56.555378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:56.556783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:56.565520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 225/445] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:56.571448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.678620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fafb38-5444-4de2-b259-cf5cfbec267c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.694793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df415ee-6a33-4b4d-9d93-b2a33d45ecb2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.712169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.712963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.713243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.713516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.721926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.725707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:22:56.728993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.729648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.729936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.730218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:22:56.733659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:22:56.734605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:22:56.735388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 221/446] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:22:56.741202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.748902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.801650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:56.803135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:56.853211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdb568-7eb7-42e2-9efa-f9d60b39be5b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:56.887212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:56.888181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:56.888460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:56.888731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:56.889482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:56.889793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:56.891182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:56.900083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 222/447] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:56.905597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.914123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 226/448] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:56.915169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:56.962373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:56.970444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:57.009228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cea4c-d5ec-49f1-80c8-ce2daba91a52 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.013201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d7ed2-eeec-4e6b-b86a-ad9588574dd0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.042417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.043070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.043353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.043627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.046946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.047822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.048104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.048376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] PATH_INFO: `/v3/projects/e2ee3d16251f43b7837010500151c1f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.049546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] RBAC: Authorizing `identity:get_project(project_id=e2ee3d16251f43b7837010500151c1f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.051022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.052763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 227/449] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/projects/e2ee3d16251f43b7837010500151c1f2 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:57.058082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:57.109137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.110577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.156913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462d7a-c4ca-489c-ac72-c589b9f534ea None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.170952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:57.174449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:57.192976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.193845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.194129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.194409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] PATH_INFO: `/v3/groups/b614c82257f245d589fb3f03b76ac6c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.195608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] RBAC: Authorizing `identity:get_group(group_id=b614c82257f245d589fb3f03b76ac6c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.197085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.198719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 228/450] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:57 2022] GET /identity/v3/groups/b614c82257f245d589fb3f03b76ac6c2 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:57.204532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:57.210838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 223/451] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:57.216360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:57.304662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9029a-4e4b-4871-a5c0-52569b91be4a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.311215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52fd5-7b01-4eba-9e8f-2491c550b5f1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.337360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.338011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.338291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.338560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.339383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] RBAC: Adding query filter params (group.id=b614c82257f245d589fb3f03b76ac6c2, role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=e2ee3d16251f43b7837010500151c1f2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:57.339685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.341136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.344595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.345460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.345743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.346019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] PATH_INFO: `/v3/projects/6c023b716ed04429bdfefdcd2624fe52` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.347217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] RBAC: Authorizing `identity:get_project(project_id=6c023b716ed04429bdfefdcd2624fe52)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.347857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 229/452] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:57 2022] GET /identity/v3/role_assignments?group.id=b614c82257f245d589fb3f03b76ac6c2&scope.project.id=e2ee3d16251f43b7837010500151c1f2&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:57.349214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.350927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 224/453] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:22:57 2022] GET /identity/v3/projects/6c023b716ed04429bdfefdcd2624fe52 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:22:57.356692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:57.410245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:57.465221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2d90-2a37-4648-8d92-25969d9049ce None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.501812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71989507-bea2-4106-b6bb-9fbe55d88466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.502599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71989507-bea2-4106-b6bb-9fbe55d88466 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.502883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71989507-bea2-4106-b6bb-9fbe55d88466 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.503158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71989507-bea2-4106-b6bb-9fbe55d88466 None admin] PATH_INFO: `/v3/groups/e35eba1f77a44529b288000c20f30eeb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.504488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71989507-bea2-4106-b6bb-9fbe55d88466 None admin] RBAC: Authorizing `identity:get_group(group_id=e35eba1f77a44529b288000c20f30eeb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.505923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71989507-bea2-4106-b6bb-9fbe55d88466 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.507547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 230/454] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 20 09:22:57 2022] GET /identity/v3/groups/e35eba1f77a44529b288000c20f30eeb => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:22:57.513786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:22:57.545903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:57.617138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c3eb6-e499-4ebb-a864-8ce463bcaae1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:22:57.653456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:22:57.654123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:22:57.654412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:22:57.654690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:22:57.655523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] RBAC: Adding query filter params (group.id=e35eba1f77a44529b288000c20f30eeb, role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=6c023b716ed04429bdfefdcd2624fe52) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:22:57.655875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:22:57.657295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c654-bc54-45ac-be0e-c1a4bcff9b6d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:22:57.663334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 225/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 20 09:22:57 2022] GET /identity/v3/role_assignments?group.id=e35eba1f77a44529b288000c20f30eeb&scope.project.id=6c023b716ed04429bdfefdcd2624fe52&role.id=2e997984fe364ad8afd717716e701a23 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:00.131045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f072-a63a-4b22-862a-82d9d192c22c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.132071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f072-a63a-4b22-862a-82d9d192c22c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.132566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f072-a63a-4b22-862a-82d9d192c22c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.134514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 231/456] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:00.140675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68352a8-6383-4ae7-ac27-c2b069263aae None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.141175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68352a8-6383-4ae7-ac27-c2b069263aae None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.141248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68352a8-6383-4ae7-ac27-c2b069263aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.164905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c68352a8-6383-4ae7-ac27-c2b069263aae None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:00.166139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c68352a8-6383-4ae7-ac27-c2b069263aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:00.260594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 226/457] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:00.309257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f072-a63a-4b22-862a-82d9d192c22c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:00.428341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4515e-9b0e-4912-b578-c70a2ec08c2d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.428539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4515e-9b0e-4912-b578-c70a2ec08c2d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.428831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4515e-9b0e-4912-b578-c70a2ec08c2d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.431900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 227/458] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:00.436734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.437310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.437783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.464521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:00.466737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:00.480520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f072-a63a-4b22-862a-82d9d192c22c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:00.504927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:00.515606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:00.543648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:00.543648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.543648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.543648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.567624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:00.569142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:00.604149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:00.605278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:00.606130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:00.606130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:00.606130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:00.606130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:00.606130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 232/459] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:00.618859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 228/460] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:00.619361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:00.685524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:00.782875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3330c-b692-430c-b023-c4b56d096746 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:00.850848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ad15-88a5-4bac-9f53-4fd618f06b16 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:00.859875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:00.861048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.861553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.862067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.864434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:00.864816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:00.867766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8eee0-5b63-4a4c-bc2e-62b9b14bea91 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:00.887027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 233/461] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:00.888848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870a70-2dfa-4891-b065-ae6e55025532 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.889143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870a70-2dfa-4891-b065-ae6e55025532 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.889422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870a70-2dfa-4891-b065-ae6e55025532 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.896521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 234/462] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:00.896521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9ddc-83cd-4a08-824f-1bdad472902a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.896521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9ddc-83cd-4a08-824f-1bdad472902a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.896521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9ddc-83cd-4a08-824f-1bdad472902a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.896521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 235/463] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:00.896521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d9ddc-83cd-4a08-824f-1bdad472902a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:00.918454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:00.919551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.920096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.920519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.927142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:00.934908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:00.936924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7cb643d2-b61d-4147-8d0d-e577842594e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:00.958211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:00.959289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:00.960719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:00.960719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:00.960719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:00.960719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:00.960719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 229/464] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:00.961010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee8da-7bab-4d51-9b12-3ebbdd2598e4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:00.961816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee8da-7bab-4d51-9b12-3ebbdd2598e4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:00.961816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee8da-7bab-4d51-9b12-3ebbdd2598e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:00.974349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:00.980531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0f7ee8da-7bab-4d51-9b12-3ebbdd2598e4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:00.981903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0f7ee8da-7bab-4d51-9b12-3ebbdd2598e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:01.027459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d9ddc-83cd-4a08-824f-1bdad472902a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.067171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.067924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.068194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.068472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.069214 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.070722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.084114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 230/465] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:01.084114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.084114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.084114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.102723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:01.104056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:01.106476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 236/466] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:23:00 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:01.107230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.190007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 231/467] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:01.190673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.248115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:01.266830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3acd-e28e-49e6-bf0a-1c1a9ea9ca8b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.268711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:01.312803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.313501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.313787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.314061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.314806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:01.315116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.317161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.322966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed8282-7511-401c-8ab9-b1b8bc1ee7ec None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.332453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 237/468] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:01.333589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.379985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.381242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.381673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.382106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.397287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.399751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:01.422054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:01.422960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:01.423799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:01.423799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:01.423799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:01.423799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:01.427876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 232/469] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:01.430367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.492461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce2ce-a734-463c-8d89-138dcf3dc12a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.528358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.529159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.529441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.529716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.541604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.543294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.547116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:01.564111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:01.565130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:01.565994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:01.565994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:01.565994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:01.565994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:01.565994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 238/470] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:01.566265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.587258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564e1e-6ba1-40eb-ad35-e6437620e3f8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.611577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:01.636788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.637883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.638495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.639108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.639969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.641868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.669651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 233/471] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:23:01 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:01.670673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.688005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1f78-3764-45ed-b5df-93436f71d20a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.761485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.762490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.763208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.763652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.764595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:01.765066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.766673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.789751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 239/472] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:01.796046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.867850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9142592-d407-4be4-a527-64a51939c197 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.879090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:01.915391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.916215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.916500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.916775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.917507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:01.917813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.919217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf666dc-e0d9-4a88-bfcc-71156fc096f9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:01.934865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 234/473] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:01.936247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82409-02eb-48dd-b3ee-ed12be2d59e1 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.936537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82409-02eb-48dd-b3ee-ed12be2d59e1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.936811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82409-02eb-48dd-b3ee-ed12be2d59e1 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.938310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 235/474] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:01.942214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82409-02eb-48dd-b3ee-ed12be2d59e1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:01.952797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61618-16c4-44b3-89a2-9d775de08235 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:01.986895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:01.991584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bd5a1-bcce-4397-9fa9-3e4b9f32f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:01.992398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bd5a1-bcce-4397-9fa9-3e4b9f32f1f2 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:01.992687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bd5a1-bcce-4397-9fa9-3e4b9f32f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:01.993055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bd5a1-bcce-4397-9fa9-3e4b9f32f1f2 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:01.993795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bd5a1-bcce-4397-9fa9-3e4b9f32f1f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:01.995423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bd5a1-bcce-4397-9fa9-3e4b9f32f1f2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:02.022662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 240/475] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:23:01 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:02.023977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:02.024267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:02.024562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:02.046315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:02.047620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:02.136458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82409-02eb-48dd-b3ee-ed12be2d59e1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:02.138005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 241/476] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:02.162240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:02.216446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:02.223409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:02.224144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:02.224428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:02.224704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:02.225419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:02.226866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:02.261633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:23:01 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:02.324229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949b804-d8aa-4d10-bfc5-52b849c77297 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:02.371373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:02.372464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:02.372984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:02.373482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:02.374454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:02.376192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:02.387865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 09:23:02.387865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 09:23:02.387865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [parameters: {'id': 'e260c6a46a8940989f093244cac565c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 09:23:02.387865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 20 09:23:02.402978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:23:02.403933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 09:23:02.405076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 09:23:02.406094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:23:02.406976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:23:02.407821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'id': 'e260c6a46a8940989f093244cac565c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:02.408628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 09:23:02.410206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:02.411040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 20 09:23:02 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:02.414240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:02.549709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:02.561076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79124895-cc7e-400d-93fc-ec0007ac1e89 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:02.601043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5531339-04b4-4c7f-8900-3130eee6c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:02.601804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5531339-04b4-4c7f-8900-3130eee6c537 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:02.602092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5531339-04b4-4c7f-8900-3130eee6c537 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:02.602374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5531339-04b4-4c7f-8900-3130eee6c537 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:02.613395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5531339-04b4-4c7f-8900-3130eee6c537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e5531339-04b4-4c7f-8900-3130eee6c537 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:02.621877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:02.622782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:02.624012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:02.629768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:02.776260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc193d-154a-42bd-838b-0e253901787d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:02.783494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:02.828430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:02.828819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:02.829108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:02.829388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:02.830163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:02.830474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:02.832429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863946e-eca4-44c5-b8a0-697963ad480d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:02.851318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:03.593118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b6b4-30cc-481a-ae91-bf3940a2575f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:03.593645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b6b4-30cc-481a-ae91-bf3940a2575f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:03.593645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b6b4-30cc-481a-ae91-bf3940a2575f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:03.595361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:03.603407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:03.604438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:03.604960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:03.625633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:03.627169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:03.703750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:03.723018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b6b4-30cc-481a-ae91-bf3940a2575f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:03.873817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b6b4-30cc-481a-ae91-bf3940a2575f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:03.915958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:03.917166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:03.917671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:03.918145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:03.936599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:03.946907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:03.947845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:03.948757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:03.952318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 239/483] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:03.960434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.108770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:04.113632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7894d-6e72-4a88-a555-0cb1cf131700 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:04.162176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:04.162778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.163063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.163342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.164129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:04.164440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:04.165830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe51f3-7529-4b51-9794-5dc3c0665518 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:04.180270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 245/484] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:04.186153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.192344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae458-41df-4a33-b891-cf7145f2b996 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.192621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae458-41df-4a33-b891-cf7145f2b996 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.192903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cae458-41df-4a33-b891-cf7145f2b996 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.194576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 246/485] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:04.202970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.202970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.202970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.209425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:04.219855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:04.221041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:04.338702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb37d5-7c92-4a2c-8ea8-bb70d88a6730 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:04.363843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 247/486] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:04.387100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.413032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:04.414168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.414603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.415029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.435148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:04.438013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:04.470899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:04.471874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:04.472971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:04.472971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:04.472971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:04.472971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:04.472971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 240/487] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:04.480657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.535761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:04.554185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0818-8f68-401f-b635-8b97b86538f5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:04.566740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:04.609406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:04.610419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.610702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.610979 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.633537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:04.642153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:04.643130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:04.644500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:04.646204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 248/488] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:04.653112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.679748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd20f9c-ff2c-46cd-a48d-da85ecdef0fc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:04.726746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:04.728013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.728729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.729162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.730312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:04.730774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:04.732511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55570c28-a65b-4d1e-8cbc-e610d3bd8447 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:04.748889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 241/489] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:04.751305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbae94-e0f3-4ee3-af79-8644dd038d49 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.751780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbae94-e0f3-4ee3-af79-8644dd038d49 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.752209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbae94-e0f3-4ee3-af79-8644dd038d49 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.755045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 242/490] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:04.756011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbae94-e0f3-4ee3-af79-8644dd038d49 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.776540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f67514-197b-4bc4-a3d8-5e0877006ec8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:04.814480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:04.815260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.815607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.816049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.818159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:04.818561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:04.820244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413ed9-d81d-489d-94c1-8ddaa100178f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:04.835474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:04.837139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.837628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.838103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.859936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:04.861170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:04.881440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:04.895622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbae94-e0f3-4ee3-af79-8644dd038d49 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:04.924461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:04.940376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:04.942139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.942871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.943451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.951526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 250/492] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:04.952350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:04.952901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:04.954141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-293d3457-d7a1-4b30-b314-392070f4c8d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:04.974540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:04.975737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:04.976711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:04.978806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 243/493] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:04.986922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008697e-d7f0-4cbe-84a9-9d2ce59e206a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:04.987296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008697e-d7f0-4cbe-84a9-9d2ce59e206a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:04.987686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008697e-d7f0-4cbe-84a9-9d2ce59e206a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:04.989248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 244/494] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:04.989919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008697e-d7f0-4cbe-84a9-9d2ce59e206a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.075352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762b6f-8102-488e-8cec-066825ab49aa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.102777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008697e-d7f0-4cbe-84a9-9d2ce59e206a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.111584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.112432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.113280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.113560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.125690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.127157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.129579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.140922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.141599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.141882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.142156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.142999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:05.143309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.144891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748cb70-90a9-4cbe-8154-ccec43ca1956 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:05.146596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:05.147378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:05.148271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:05.148271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:05.148271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:05.148271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:05.152030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:05.153142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.187282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 245/496] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:23:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:05.188420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.188710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.188987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.207750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:05.208963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:05.246069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.273582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c18c7d-30f9-4db7-a334-a7f23515e8a7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.283765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 246/497] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:05.283765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.325651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.327116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.327552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.328011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.341702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:05.353508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:05.354449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:05.355238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:05.357372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 252/498] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:05.358364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.387197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37457c7-d1e1-4a1f-92b5-2c5bcc282a1a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.422598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.425791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.426668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.427125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.427587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.428412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:05.428722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.430115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.442717 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 247/499] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:05.443562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.475833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0951-f326-4944-af2e-f6d535a6bd92 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.479343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.512183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.513357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.513640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.513919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.555569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7cbc9-0d63-4e92-b80d-c719ed8a61e8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.589490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.590963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.595619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.596468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.596755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.597059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.608733 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:05.616812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:05.617748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:05.618564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 248/500] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:05.619201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.658338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.708630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 253/501] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:05.709478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.725234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.735291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f309-0a04-4ee2-ab70-bffbf54bac97 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.769963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.770643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.770932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.771210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.771989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:05.772303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.773674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.781626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 249/502] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:05.782413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.811069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e8089-a720-4c63-a993-094ab8fe3ef9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.847675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.848512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.848799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.849078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.856196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.857628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cfb6025e-7a14-473d-8ad8-e083f937e77b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:05.873967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:05.874874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:05.875781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 254/503] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:05.876813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbece01-f3de-4803-b655-fa3902b84333 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.876813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbece01-f3de-4803-b655-fa3902b84333 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.876960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbece01-f3de-4803-b655-fa3902b84333 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.878244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 255/504] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:05.880791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbece01-f3de-4803-b655-fa3902b84333 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.888289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be49c-5f36-4039-968f-89d8a8e74df4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:05.897419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.923246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:05.923956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:05.924244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:05.924545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:05.925817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:05.926126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:05.927499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:05.937671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 250/505] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:05.938775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:05.961855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:05.995504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbece01-f3de-4803-b655-fa3902b84333 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.029441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.030244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.030527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.030831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.041197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.042644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.050644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10911f-895a-4422-ad04-e675fc892daa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:06.060627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:06.061548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:06.062385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:06.062385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:06.062385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.062385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:06.063866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 256/506] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:06.064873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.084922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.085722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.086009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.086289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.097992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.099431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d5c265ea-44c6-4a84-8348-30f09e27e0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:06.116710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:06.117762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:06.118638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:06.118638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:06.118638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.118638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:06.118638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 251/507] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:06.119103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.119335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.119618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.136279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:06.137464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:06.139929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.176035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ddda-eca1-468f-89ac-fbec744b0003 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.197749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.205688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 252/508] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:06.206595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.211498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07543-e430-4487-9287-418e37318732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.212275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07543-e430-4487-9287-418e37318732 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.212624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07543-e430-4487-9287-418e37318732 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.212992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07543-e430-4487-9287-418e37318732 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.213899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07543-e430-4487-9287-418e37318732 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:06.214286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07543-e430-4487-9287-418e37318732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.215812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07543-e430-4487-9287-418e37318732 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.255911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 257/509] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:06.255911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07543-e430-4487-9287-418e37318732 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.323538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0bc45-2dfa-4be7-8836-b80a9956e642 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.355080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07543-e430-4487-9287-418e37318732 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.356810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.357603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.357882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.358151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.368597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.370024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.379498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:06.388697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:06.389526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:06.390340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:06.390340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:06.390340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.390340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:06.390340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 253/510] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:06.390649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.391699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.392404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.392693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.392975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.393706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:06.394113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.395611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.406997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 258/511] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:06.407827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.439945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.489521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e13e63-7e0f-43e9-b4aa-865aa3cf10fd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.510855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371a22a-944d-452f-9302-71d38a247c4b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.524804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.525476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.525763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.526041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.526766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:06.527075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.528473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.540076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 254/512] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:06.541038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.545393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.546222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.546510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.546789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.558006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.559452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:06.576614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:06.577553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:06.578391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:06.578391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:06.578391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:06.578391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:06.578391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 259/513] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:06.578646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.616270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.640028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f9a1-a50a-4d89-a76f-04b821134397 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.649803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.675762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.676423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.676711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.676982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.683082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e2fac-83ff-46a8-801a-7e470b68b0ee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.717196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.718069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.718355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.718633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.719365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:06.719675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.721086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.732990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 260/514] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:06.733792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.742813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.744301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.831862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.838129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90e78-eef4-4896-85e1-b1072f7d1d0a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.848477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 255/515] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:06.849165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.859458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:06.874168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.874974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.875262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.875539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:06.882975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:06.884485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:06.899662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:06.900734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:06.901550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 261/516] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:06.902012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:06.954668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d493c23-8a3a-49ff-9de0-8406e87223f4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:06.992936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:06.994030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:06.994311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:06.994578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.002457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.003923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.014744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b438e4-4de6-4ca8-85cf-92c818b5d7b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:07.019648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:07.020552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:07.021434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 256/517] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:07.022283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.051439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.052140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.052423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.052702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.053424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:07.053731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.055115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.066935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 262/518] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:07.067768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.085769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.092724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.126447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c1150-259c-4e48-811f-a4f671694b97 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.160133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.160969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.161258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.161534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.168640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.169298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d88e1-15ad-463b-b0f9-eb7b23237ee4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.170068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:07.185121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:07.186101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 257/519] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:07.187155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.206445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.207240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.207519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.207817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.217735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.219163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:07.236885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:07.238330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:07.239185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:07.239185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:07.239185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:07.239185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:07.239185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 263/520] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:07.239489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.291000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f4cc4-6656-47d1-8f04-5fb1ba23450b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.305394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.329678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.339211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.339845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.340136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.340418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.341217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:07.341533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.342999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.344280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07e1da-1df7-4549-a3f8-5be1a3a2fe5f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.362541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 258/521] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:07.363394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.380504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.381185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.381466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.381746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.382586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:07.382891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.384374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.402258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 264/522] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:07.403061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.464721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700255f2-f07d-4a64-af44-19f6ec77e50e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.498585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.499255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.499539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.499846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.500544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.501983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.502315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffac8-182d-43cf-872e-40bc43bd8141 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.522971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 259/523] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:23:07 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:07.523833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.536466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.542221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.543032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.543321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.543748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.544629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:07.544942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.546440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.567650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 265/524] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:07.573115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.583560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.650133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03081fb5-8c69-4d04-af77-4ec47cdb9205 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.691578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.692280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.692561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.692836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.693554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:07.693858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.695240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.705725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c6ee-9791-41c8-b32d-c02244d540cc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.708224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 260/525] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:07.709120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.748970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.749638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.749919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.750191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.751023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=aebe4b5d4c0c40218341971859875d67) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:07.751331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.752808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:07.758862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/role_assignments?user.id=aebe4b5d4c0c40218341971859875d67&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:07.760857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:07.835342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2255c-c5a4-4c66-82c1-59da52e3037c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.840055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.845643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:07.891968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.893158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.893657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.894345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.904736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8d24b-278c-43ba-96cf-9bc6377fab40 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:07.951042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:07.952224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:07.952517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:07.952794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:07.979766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:07.982225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.046213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.048202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.095760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 261/527] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:08.095760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.096639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.106627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.169880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 267/528] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:08.169880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.214642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65de0-a50f-453a-9559-72abb86e8530 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.262239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.264292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.264577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.264854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.275215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.277190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:08.292189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:08.293026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:08.293833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:08.294222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ce41-7c27-4ca4-b92c-32b732b31cc7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.301422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 262/529] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:08.302724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.339619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.341349 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.341823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.343555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.362403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.364022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.375430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:08.388985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:08.389858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:08.390712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:08.390712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:08.390712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:08.390712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:08.390712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 268/530] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:08.391470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.416106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.425265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897edd84-6a74-4d91-8e42-0948a871006b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.469073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.469880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.470163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.470547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.482126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.483847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:08.504084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:08.504947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:08.505762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:08.505762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:08.505762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:08.505762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:08.505963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 263/531] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:08.507003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.514676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc86d0-2497-485f-ad53-0c9b3448dd51 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.552693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.553472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.553762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.554039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.554835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:08.555143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.556817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.578790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 269/532] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:08.579886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.619239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4d8d0-9cf0-472c-8779-9c8c6f7dae9e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.636884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.654637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.658519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.659277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.660182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.660526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.661392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:08.661706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.663264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.676257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 264/533] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:08.677191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.706496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392589ed-eb3d-4583-b3b3-f802dd7dc4b9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.746280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.746972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.747260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.747535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.748333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:08.748687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.750362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.764366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 270/534] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:08.765367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.787686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a336-6e81-41a3-baa1-5bd9a6138c6a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.824018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.824412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.825264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.825264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.826007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=5c6736109f3549eb85021ce2d6a23436) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:08.826612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.829432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.835213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 265/535] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/role_assignments?user.id=5c6736109f3549eb85021ce2d6a23436&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:08.836277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:08.878481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631ae6-ecb2-47e6-a62e-5c51aeaec7e6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.884357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.905042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:08.922005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:08.922945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:08.923294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:08.923642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:08.932180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:08.933973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:08.951462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:08.953230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:08.955195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 271/536] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:08.956817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e54d-984d-414a-9ca3-0099c45b3c08 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:08.963794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:09.021454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:09.022289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.022576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.022857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.037466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:09.038965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:09.056827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:09.057828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:09.058656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 266/537] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:09.069051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:09.110482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed580e-7cb7-4225-a6c3-8266e7fd1559 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:09.152320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:09.153229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.153684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.154108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.155098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:09.155629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:09.157243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:09.170642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 272/538] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:09.176663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:09.188344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:09.191756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad99d-7573-46e9-9ffb-58a117828cb5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:09.226091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:09.231624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:09.232332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.232972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.232972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.233784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:09.234100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:09.235536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:09.254089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 267/539] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:09.255744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:09.293148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ce9f-9c2b-4255-8776-71610efa3b87 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:09.330004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:09.331158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.331784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.332262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.333302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=92f96e51cfa14f148a5dd3ebd18f591c) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:09.333816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:09.335464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59b230-49b7-48b3-abfc-e6f664e29c0f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:09.342388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 273/540] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:09 2022] GET /identity/v3/role_assignments?user.id=92f96e51cfa14f148a5dd3ebd18f591c&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:09.365678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f514fa-2501-4fb7-8e47-b8b33acd2a55 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:09.404684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:09.405369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.405653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.405930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.406784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=e8fa8ef7d61f483db27148b5e316db3c) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:09.407098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:09.408729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80856a-ffd1-46fd-a9b3-8a38c461c170 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:09.419841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 268/541] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:09 2022] GET /identity/v3/role_assignments?user.id=e8fa8ef7d61f483db27148b5e316db3c&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:09.756615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f47c-e163-4f83-88dd-0b7c6b8c1ac9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.757153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f47c-e163-4f83-88dd-0b7c6b8c1ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.757153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f47c-e163-4f83-88dd-0b7c6b8c1ac9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.758877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 274/542] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:09.765020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:09.765308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:09.765585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:09.788206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:09.789450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:09.813107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:09.886160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 269/543] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:09.918268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f47c-e163-4f83-88dd-0b7c6b8c1ac9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:10.076293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f47c-e163-4f83-88dd-0b7c6b8c1ac9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:10.084791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:10.125872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:10.126685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.126969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.127247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.144603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:10.152485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:10.153328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:10.154259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 275/544] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:10.160104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:10.315243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463848-9276-4cc2-9309-ad40240b395c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:10.350083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:10.350737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.351017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.351285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.352101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:10.352406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:10.353781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea899f0-c670-473e-8dfd-2a42b9405d78 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:10.362357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 270/545] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:10.368524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:10.412427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668847-0157-4187-b356-7b60135b5bad None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.412764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668847-0157-4187-b356-7b60135b5bad None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.413004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668847-0157-4187-b356-7b60135b5bad None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.414637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 271/546] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:10.419547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.419872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.420154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.439040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:10.440357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:10.457165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:10.552441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 272/547] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:10.567506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7887-dc74-4b4c-ab5a-5b01ffb7e7b5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:10.593308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:10.641958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:10.642752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.643042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.643323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.663266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:10.664770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:10.694087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:10.694961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:10.695954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:10.695954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:10.695954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:10.695954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:10.695954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 276/548] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:10.700656 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:10.726597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:10.778573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0148f-02fc-4e9d-8e49-ef6e1d6808ae None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:10.855908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:10.856720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.857003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.857276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.879912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:10.889072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:10.890407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:10.891706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:10.892540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 273/549] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:10.896332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:10.899129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6efa8-711d-4592-8df4-eccf87ca0b61 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:10.911396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:10.942542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:10.943219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:10.943507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:10.943790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:10.944527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:10.944833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:10.946196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:10.970316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 277/550] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:10.980948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.078174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:11.103175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddab82-5dde-4aaf-b56f-a8f06f9361a1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.107489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377994b9-c590-4ea3-9189-d436a216e648 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.154756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.156053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.156340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.156613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.157578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:11.157886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:11.159288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:11.173831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.174658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.175694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.175998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.181996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 274/551] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:11.187298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.192231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:11.195824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:11.228423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:11.229454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:11.230425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 278/552] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:11.237122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.319906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:11.384255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db2e2-6823-4b87-8d7e-2ca10fd3f9fa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.421872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ef0e2-28b3-4c52-ba5d-3cbd09870980 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.452568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.453393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.453683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.453963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.469708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:11.471172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:11.471658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.472996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.473279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.473561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.474419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:11.474722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:11.476192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd92af-3183-4409-abb4-3324f67b613b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:11.479021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8a25d61b-d155-46ea-ad34-36422cb0acd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:11.492960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:11.494169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:11.495245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:11.495245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:11.495245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:11.495245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:11.497249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 275/553] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:11.498787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9546-b5a7-40ee-8069-64a5dc1ab33e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.499223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9546-b5a7-40ee-8069-64a5dc1ab33e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.499654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9546-b5a7-40ee-8069-64a5dc1ab33e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.501431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 276/554] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:11.502943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9546-b5a7-40ee-8069-64a5dc1ab33e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.514397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 279/555] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:11.514397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.514397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.514397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.532413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:11.533635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:11.606258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 280/556] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:11.607913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.642607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9546-b5a7-40ee-8069-64a5dc1ab33e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.666781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:11.684944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.685385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.685672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.685944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.686678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:11.688890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:11.688890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:11.707232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 277/557] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:11.707232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.736273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07fa0f-0cfc-4d35-8117-b70eb61187e7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.763788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:11.776361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eac22c-19b1-4102-992d-253e69d20ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.777026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac22c-19b1-4102-992d-253e69d20ffc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.777307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac22c-19b1-4102-992d-253e69d20ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.777689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac22c-19b1-4102-992d-253e69d20ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.818096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae190ac-6b1b-4db2-9fde-4c50788c41ea None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:11.858767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:11.859589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.859907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.860157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.861698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eac22c-19b1-4102-992d-253e69d20ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:11.863828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eac22c-19b1-4102-992d-253e69d20ffc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:11.872045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:11.881825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:11.891132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 278/558] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:11.893151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:11.928583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:11.984975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 281/559] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:11.986383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b044f-acdf-4198-8ee2-2effac6b53b8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:11.986669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b044f-acdf-4198-8ee2-2effac6b53b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:11.986994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b044f-acdf-4198-8ee2-2effac6b53b8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:11.988870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 282/560] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:11.989620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b044f-acdf-4198-8ee2-2effac6b53b8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.002555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328663-73b3-41bc-898e-0797886b19aa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.023239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.042979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.043872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.044155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.044494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.052925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.054376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-17591c50-5f07-4940-8adf-d54607121bdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:12.069199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:12.070334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:12.071282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 279/561] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:12.072014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b307af-b944-4f67-97bf-f63295e0c066 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.072333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b307af-b944-4f67-97bf-f63295e0c066 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.072556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b307af-b944-4f67-97bf-f63295e0c066 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.073811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 280/562] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:12.075947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b307af-b944-4f67-97bf-f63295e0c066 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.107961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b044f-acdf-4198-8ee2-2effac6b53b8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.142915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.144107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.144424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.144700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.145446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:12.145754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.147122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375200b6-97e4-40c4-b5a7-4ffbca9f734f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.155017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 283/563] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:12.156241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.156534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.156816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.174693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:12.175976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:12.179369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.183819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b307af-b944-4f67-97bf-f63295e0c066 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.218027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.218824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.219107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.219459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.229396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.230853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.244249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 284/564] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:12.245021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6821ba5a-0c4b-4580-a531-486001abf890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:12.249296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:12.250297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:12.251233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:12.251233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:12.251233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:12.251233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:12.251892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 281/565] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:12.253632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.253922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.254192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.271347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:12.272562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:12.275165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.351847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 282/566] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:12.356770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.358319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2bb50-5f8a-47fc-92b8-28561ac540bf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.395315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.396027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.396314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.396590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.397433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:12.397743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.399181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.415991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 285/567] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:12.416777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.441879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.460986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd0a83-3ba2-43e3-ac18-2b0d737607cd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.491896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.496132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.496951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.497308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.497594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.508961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.510416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.518270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388dc13-24ca-4e93-9bd7-a7c823cc3313 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:12.530008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:12.530921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:12.531794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:12.531794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:12.531794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:12.531794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:12.531794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 283/568] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:12.532088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.556799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.557468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.557746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.558020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.558737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:12.559042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.560440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.571980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 286/569] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:12.573072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.632194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ca2f2-40cc-481f-a906-cde6dc38e6f4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.665754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.666568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.666848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.667124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.669234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.676944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc533-fbea-42f3-95ce-125228ff7306 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.679264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:12.686927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:12.687917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:12.688764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 284/570] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:12.689744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.716323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.717127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.717407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.717684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.719553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.729684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:12.738072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:12.739164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:12.740038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 287/571] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:12.740715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.791042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7922ea-9082-41f0-8bb9-7c881d5cb262 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.826496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.826496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.826496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.826496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.837435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.838904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.850201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e40515-a105-4724-90dc-50a898ec3847 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:12.856636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:12.857574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:12.858440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:12.858440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:12.858440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:12.858440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:12.858440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 285/572] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:12.858711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.887013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.887976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:12.888260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:12.888534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:12.889266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:12.889583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:12.890960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:12.903086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 288/573] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:12.903740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:12.911704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.961921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.965300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827792-0b01-4ffd-948c-b0a5901a5977 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:12.998953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:12.999765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.000049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.000326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.006966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e47c8-25b2-4916-9554-4a904b656921 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.007411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.008734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:13.023903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:13.024815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:13.025681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 286/574] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:13.026147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.047424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.048636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.049022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.049510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.051292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.051841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.054088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.071490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 289/575] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.071490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.137141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a41a9e-fba5-4325-9a1a-7d18b9cee79b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.144993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.172705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.173372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.173650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.173921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.174562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ace8-58ac-4e38-a69c-a7201f043689 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.174661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.174962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.176353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.184286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 287/576] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.188596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.192107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.211170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.211899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.212187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.212469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.213197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.213504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.214879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.226535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 290/577] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.227338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.288183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41d50-1a20-494a-8de4-b8e1110b0296 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.320921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.321646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.321931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.322206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.326168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06392b4a-cf37-4646-b706-95c6c3ef2a8b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.329680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.331621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:13.345660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:13.346636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:23:13.348207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:13.352186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 288/578] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:13.352810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.360888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.361585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.361868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.362148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.362988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.363296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.364757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.376125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 291/579] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.376940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.385231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.412578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.457456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e2ba-a986-4cca-a6dc-ab8aa0a09487 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.478744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e171a4-cfad-4518-98cd-ffa4320b2764 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.491386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.492225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.492514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.492790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.503371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.504862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.512240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.513286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.513564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.513840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:13.522556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:13.523433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:13.524347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:13.524347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:13.524347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:13.524347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:13.524347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 289/580] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:13.524971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.528908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.530407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:13.548211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:13.549245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:13.550849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:13.550849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:13.550849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:13.550849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:13.550849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 292/581] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:13.551349 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.610736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.633125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a5671-6bcc-46d2-a9e3-8e5ac507a58e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.638991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.652018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc3cc8-866d-4373-b0d2-def804ba14e7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.667777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.668569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.668844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.669116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.676008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.677534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.685995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.686668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.686955 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.687236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.688100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.688411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.689827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:13.691890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:13.692936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 290/582] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:13.694036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.710697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 293/583] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.711512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.795217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de9b6e-ff28-4fd8-9c00-44f7514a4361 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.809934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05d2d3-8a83-43f5-8113-ca80bacf32f1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.833656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.834320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.834604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.834882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.835743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=92eaddc698594f328d27c7e3c7bf6a02) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.836056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.837475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.842840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 291/584] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/role_assignments?user.id=92eaddc698594f328d27c7e3c7bf6a02&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.843653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.844109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:13.844783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:13.845176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:13.845524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:13.846333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:13.847236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:13.848738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:13.853624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.872503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 294/585] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:13.873806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:13.885549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.978806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3acf9-fb07-4d32-bbc0-b192c5fa46f1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:13.991619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613d78-ec02-47ad-bd53-1bea6fe6ab3f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.014932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.015609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.015923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.016200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.016927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:14.017236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.018835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.028918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.029691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.029982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.030321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.031123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:14.031436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.037231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 292/586] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:14.037414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.037507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.052485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 295/587] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:14.053241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.116163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.130132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.157126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef48a39-d6b4-44c0-b20b-debba03f3b32 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.167926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6d75c-6a95-4b25-b6dd-c5ae44891db1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.194538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.195346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.195633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.195948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.205574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489dad8-c526-423b-9854-187513226e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.206286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.206486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489dad8-c526-423b-9854-187513226e74 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.206703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489dad8-c526-423b-9854-187513226e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.206983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489dad8-c526-423b-9854-187513226e74 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.207758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.214257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489dad8-c526-423b-9854-187513226e74 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.215690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489dad8-c526-423b-9854-187513226e74 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:14.225676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:14.226549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:14.227393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:14.227393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:14.227393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:14.227393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4489dad8-c526-423b-9854-187513226e74 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:14.230372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:14.231225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:23:14.232610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:14.233208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 293/588] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:14.233208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.237230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 296/589] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:14.237230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489dad8-c526-423b-9854-187513226e74 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.344114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489dad8-c526-423b-9854-187513226e74 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.344673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116ebdd-ef23-40e2-8ec7-e23031b0110b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.364874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.374573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.385425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.386270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.386489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.386678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.387024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.387605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.388374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.388722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/aebe4b5d4c0c40218341971859875d67/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.396772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.398331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.405538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=aebe4b5d4c0c40218341971859875d67, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.407047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:14.413310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:14.414452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:14.415558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:14.419524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 294/590] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:14.420192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.424493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 297/591] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:14 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/aebe4b5d4c0c40218341971859875d67/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:14.425922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.540667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1ad0d-8b0a-451d-91b6-a639e9758c89 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.548105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e035b8-c41d-4933-9ab8-783d033434dd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.585431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.586856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.586856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.587258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.588181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:14.588669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.590327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.590874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.591706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.592157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.592630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.593563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:14.594133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.595513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.609810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 295/592] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:14.611360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.613420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 298/593] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:14.616417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.657458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.658993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.738919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaada1-769e-46fc-abc9-09138af71932 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.743407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283c57e-2acb-42ad-be61-68459007eec1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.776241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.777340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.777772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.778246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.784797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.785493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.786023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.786307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.787015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.787155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:14.787448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.788916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.789059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:14.808322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:14.809442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:14.810470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:14.810882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 296/594] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:14.810882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.817451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 299/595] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:14.818627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:14.915734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.922210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb078a94-277b-4876-915f-4eda90a28a5f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.938870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:14.947239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a09463-65b5-4c36-85ad-22a20d33ddcf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:14.961171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.962001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.962283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.962555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.973667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:14.975023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:14.996386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:14.996589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:14.997736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:14.998598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:14.998598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:14.998598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:14.998598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:14.998816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:14.998816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:14.998816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:14.999004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 297/596] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:14.999004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.011922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.013755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:15.034072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:15.036689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:15.038891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:15.038891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:15.038891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:15.038891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:15.038891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 300/597] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:15.038891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.105132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff715-265b-4ddd-b6de-6cd9eea9455b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.141685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9946-d925-4215-8229-06fe93408113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.142348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9946-d925-4215-8229-06fe93408113 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.142633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9946-d925-4215-8229-06fe93408113 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.143203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9946-d925-4215-8229-06fe93408113 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.144704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db9946-d925-4215-8229-06fe93408113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:15.145114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db9946-d925-4215-8229-06fe93408113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.146805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db9946-d925-4215-8229-06fe93408113 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.149996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06124a-c23b-437d-bb2b-e7258ca8b8eb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.167829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 298/598] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:15.167829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9946-d925-4215-8229-06fe93408113 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.175193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:15.191868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.192897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.193384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.193906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.194830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:15.195363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.197017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.211471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 301/599] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:15.212765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.222343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:15.298797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9946-d925-4215-8229-06fe93408113 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.328558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225c2a-51db-449b-b471-514ec61ddbb2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.342535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.343202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.343483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.343777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.344768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:15.345074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.347437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.362726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 299/600] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:15.364039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.375764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.376959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.377450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.378450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/5c6736109f3549eb85021ce2d6a23436/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.395803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=5c6736109f3549eb85021ce2d6a23436, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.397588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.423634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 302/601] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:15 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/5c6736109f3549eb85021ce2d6a23436/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:15.425026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.482419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:15.550465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:15.554908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0446-d067-4f6f-b203-a21700f32e5c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.629823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.630635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.630915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.631185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.639392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65796a-06be-4752-ad4d-a2a049ed2e24 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.646256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.648127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:15.664065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:15.665025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:15.665894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:15.668515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 300/602] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:15.674118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.681596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.682410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.682690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.682963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.691500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.693123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:15.709047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:15.709976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:15.710845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:15.713011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 303/603] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:15.716400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.818404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96631f-9e7e-4107-9abf-d37ccd574078 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.874143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:15.877981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fd0c1-c939-4096-ae3f-86d195a8ddac None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:15.895828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.896503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.896788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.897067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.897864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:15.898173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.899609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794c7a-eee5-45fe-81d0-51f4850c0a1c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.914128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:15.924203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 301/604] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:15.926476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8d88-7de8-42a8-a1e7-c98ca5e19a13 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.926771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8d88-7de8-42a8-a1e7-c98ca5e19a13 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.927050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8d88-7de8-42a8-a1e7-c98ca5e19a13 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.928343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 302/605] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:15.930407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8d88-7de8-42a8-a1e7-c98ca5e19a13 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:15.948998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:15.949855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.950075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.950355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.951160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:15.951493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:15.953099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc4b6-e95e-4650-8d35-79ed9f48ed9c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:15.971478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 304/606] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:15.973561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:15.973855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:15.974137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:15.992583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:15.993881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:16.066616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8d88-7de8-42a8-a1e7-c98ca5e19a13 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:16.079491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 305/607] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:16.079491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:16.132508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:16.133408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.133694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.133973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/e8fa8ef7d61f483db27148b5e316db3c/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.150700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=e8fa8ef7d61f483db27148b5e316db3c, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:16.152336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:16.175837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 303/608] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:15 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/e8fa8ef7d61f483db27148b5e316db3c/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:16.175837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:16.219311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:16.297493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3772b-813b-4e88-97c5-4510bb07e080 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:16.302747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c3de3-2bcb-4471-b402-7c061bad208e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:16.315750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:16.344951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:16.346139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.346425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.346847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.359303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:16.374347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:16.375488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:16.376339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 304/609] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:16.394138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:16.395473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.395982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.396503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/92f96e51cfa14f148a5dd3ebd18f591c/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.417311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:16.419039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=92f96e51cfa14f148a5dd3ebd18f591c, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:16.420776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:16.439448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 306/610] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:16 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/92f96e51cfa14f148a5dd3ebd18f591c/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:16.545690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:16.553247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc9b43-24bd-4a6c-9431-997fa3953b4f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:16.605152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:16.605884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.606168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.606496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.607272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:16.607588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:16.609045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b93d10-ab82-4664-9aa0-748b3169d0ce None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:16.623782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 305/611] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:16.629436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:16.723711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0b2a-817b-4f27-8487-be448f964568 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.724059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0b2a-817b-4f27-8487-be448f964568 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.724308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec0b2a-817b-4f27-8487-be448f964568 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.726133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 306/612] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:16.732714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.733033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.733278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.756723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1747c2-d0fe-49ef-b07b-bc6193e2741a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:16.771635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:16.772884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:16.850620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 307/613] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:16.857404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:16.858238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:16.858523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:16.858801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:16.870427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:16.871927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:16.890757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:16.891966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:16.893071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:16.893071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:16.893071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:16.893071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:16.893352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:16.895526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 307/614] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:16.901108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:16.928450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:17.030832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:17.052784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa19a-551c-4689-a0c5-f374665e8b71 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.104763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5692-bfbc-48b7-8bcc-d8e7691538dc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.110186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.111072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.111427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.111805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.132532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:17.147139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:17.148182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:17.149050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:17.151592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 308/615] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:17.157099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:17.173008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.173708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.173999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.174282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.175568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:17.175912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:17.177312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:17.199283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 308/616] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:17.203213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:17.321607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:17.323625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499253-9b35-41d2-9907-ee9fe43b3709 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.365875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.368900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.368900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.368900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.368900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:17.368900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:17.372802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:17.388869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 309/617] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:17.394956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:17.410505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830c38b-b5dc-4526-87f9-666daf05eb97 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.428087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:17.514882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.516066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.516519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.516963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.521069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492297c1-50d6-41e6-b9ff-e174ab2aee5c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.544078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:17.545889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:17.570109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:17.571247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:17.572252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:17.573821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.574953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.575306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.575653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.576319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 309/618] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:17.586061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:17.594333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:17.595755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:17.637436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:17.639831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:17.642113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:17.642113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:17.642113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:17.642113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:17.645767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 310/619] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:17.646581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:17.793582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf5aad-7440-4744-81b1-b4956401d687 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.809575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:17.829589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:17.833451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.834162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.834590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.834877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.835765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:17.836628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:17.839141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc29ce-9c65-44b3-9f11-117b9d4ab84e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:17.860095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 310/620] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 20 09:23:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:17.861518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26737a27-ebc2-4870-88d8-5c87c31bacc6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.861820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26737a27-ebc2-4870-88d8-5c87c31bacc6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.862108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26737a27-ebc2-4870-88d8-5c87c31bacc6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.864243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 311/621] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:17.869283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26737a27-ebc2-4870-88d8-5c87c31bacc6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:17.891218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5878b4-17b8-415b-979b-35c8a9a16839 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:17.927235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:17.927974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.928259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.928537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.929321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:17.929750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:17.931239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c677c1-a028-4bc8-89e3-7af6428666df None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:17.944676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 311/622] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:17.946024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:17.946286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:17.946561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:17.964432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:17.965627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:17.976380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26737a27-ebc2-4870-88d8-5c87c31bacc6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.011389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.012231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.012513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.013089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.024673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.026274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.043969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 312/623] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:18.044882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:18.045916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:18.047156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:18.048091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:18.048091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:18.048091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:18.048091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:18.053003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 312/624] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:18.054397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.112305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.136130 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.178711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06218ce3-ea0e-4902-8052-5b2c4e1c857d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.179585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e20d1-c790-4c1b-97c7-1b565a224216 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.215683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.216077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.216548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.216801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.216988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.217154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.217312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.217457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.218076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:18.218381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.219769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.225858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.227320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.238791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 313/625] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:18.239782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:18.243013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:18.245275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 313/626] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:18.247652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.347791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.352321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac97499-adb5-4cd7-b9ab-880f9b5d17b6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.355761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2b41-1efd-46bc-9953-c30e3e3a518c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.370192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.399758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.399758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.399758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.399758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.400218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.400898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.400898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.401179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.408087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.410277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.414082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:18.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:18.423239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:18.424277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 314/627] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:18.425333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:18.431180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:18.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:18.433016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:18.436055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 314/628] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:18.437490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.545831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ecda3-515b-474d-aff7-cee3af571309 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.579682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430052-650e-47d7-825d-ca61ca5b099d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.582651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.583347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.583636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.583964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.584824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:18.585140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.586596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.610147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 315/629] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:18.611051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.630368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.630860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.631731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.632795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.633348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.634260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:18.634723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.637289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.650214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 315/630] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:18.651366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.688288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.753673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14f9c-3d48-47a3-a7f9-3ee6316f626d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.766486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f84ce2-8768-4af0-ad92-c42b677628d0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.792205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.792885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.793169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.793447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.794235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:18.794555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.796023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.803092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8d5e4-430b-49a6-990f-a1c3bc3f8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.804112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d5e4-430b-49a6-990f-a1c3bc3f8566 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.804603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d5e4-430b-49a6-990f-a1c3bc3f8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.805081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d5e4-430b-49a6-990f-a1c3bc3f8566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.811775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 316/631] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:18.812615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:18.887310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d5e4-430b-49a6-990f-a1c3bc3f8566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.889478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d5e4-430b-49a6-990f-a1c3bc3f8566 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.898805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.922269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a845-973d-4ed5-b9ad-bcf5deedaaff None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:18.923078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:18.958513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:18.959232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.959514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.959815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.970228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:18.971696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a456f678-28fa-4190-96b2-0e125737a92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:18.988372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:18.989579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:18.990446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:18.990446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:18.990446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:18.990446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:18.990446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 317/632] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:18.991169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390286c-7bda-446e-a87a-86cd8840690b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.991476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390286c-7bda-446e-a87a-86cd8840690b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.991747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390286c-7bda-446e-a87a-86cd8840690b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.996974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 318/633] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:18.997112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 316/634] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:18.997112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222c3de-5cd7-4403-be50-f195cddaa7d6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:18.997112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222c3de-5cd7-4403-be50-f195cddaa7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:18.997112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222c3de-5cd7-4403-be50-f195cddaa7d6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:18.997401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390286c-7bda-446e-a87a-86cd8840690b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.000194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 317/635] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:19.001038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222c3de-5cd7-4403-be50-f195cddaa7d6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.110493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222c3de-5cd7-4403-be50-f195cddaa7d6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.111368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390286c-7bda-446e-a87a-86cd8840690b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.139746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:19.146769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.147435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.147733 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.148017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.148498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.148736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:19.149040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.149393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.149678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.149956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/92eaddc698594f328d27c7e3c7bf6a02/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.150433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf071b-b563-4bea-bb80-ef8ff906e442 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.151929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:19.164059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 318/636] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:19.165295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e610497-aad9-4188-9cee-5f8d223c02dc None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.165583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e610497-aad9-4188-9cee-5f8d223c02dc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.165693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=92eaddc698594f328d27c7e3c7bf6a02, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.165871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e610497-aad9-4188-9cee-5f8d223c02dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.167172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.180077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 319/637] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:18 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/92eaddc698594f328d27c7e3c7bf6a02/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:19.180889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.183404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2e610497-aad9-4188-9cee-5f8d223c02dc None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:19.184654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2e610497-aad9-4188-9cee-5f8d223c02dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:19.266006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 319/638] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:19.267762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.268048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.268354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.288860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:19.290189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:19.315971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d299-c7ba-420b-87b7-3953454c1255 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.357865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.359370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.359985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.360528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.372991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 320/639] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:19.379826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.382113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.383764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:19.408719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:19.409715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:19.410579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:19.410579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:19.410579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:19.410579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:19.410887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 320/640] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:19.412090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.445402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:19.453209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:19.500784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f89c38-3fb2-451e-9cd7-953db9925d93 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.531233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76473b3b-3191-424f-b0db-3b320ec857b1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.538675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.539494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.539809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.540083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.547671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.549166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:19.564243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:19.565234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:19.566160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 321/641] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:19.566777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.573485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881c98-a738-469f-8711-f235d04e004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.574300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881c98-a738-469f-8711-f235d04e004d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.574587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881c98-a738-469f-8711-f235d04e004d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.575306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28881c98-a738-469f-8711-f235d04e004d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.587974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28881c98-a738-469f-8711-f235d04e004d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-28881c98-a738-469f-8711-f235d04e004d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:19.595863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:19.597443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:19.598285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 321/642] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:19.598992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881c98-a738-469f-8711-f235d04e004d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.681127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50776d62-0c56-4c41-96cf-b1dcd3e479f2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.697437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:19.701161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:19.712309 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28881c98-a738-469f-8711-f235d04e004d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.719978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.720954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.721369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.722068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.734076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:19.742384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:19.743386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:19.744312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 322/643] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:19.745049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.779675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.780438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.780728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.781010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.781808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:19.782129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.783543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.806612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 322/644] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:19.807972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.902695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64057e4-9798-44d6-aba1-cdcf784f0c75 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.926552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3690fe-8097-4ef5-ba17-d9166f861db9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:19.939562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.940355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.940708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.941065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.941972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:19.942363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.943887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.966694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 323/645] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:19.966694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:19.968392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:19.969318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:19.969840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:19.970335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:19.971345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:19.972430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:19.974130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:19.983183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 323/646] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:19.984271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.002077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.007139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.102474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54548-04f5-46ef-9372-bdfdafa3206d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.111629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1fba3-5b26-4716-ae32-2fe7c88121fd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.143281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.144520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.144811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.145076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.146138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:20.146322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.148338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.158276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.160599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.161107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.161608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.164425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 324/647] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:20.165462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.171138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.172930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:20.191358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:20.192318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:20.193199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 324/648] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:20.193669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.278193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.297310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.304928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349de970-1ce8-44be-ac16-65d996bdce81 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.311736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1ee2d-fd78-4141-ac21-e30f6e0605bb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.347400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.348219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.348615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.348909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.351963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.354046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.354046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.354046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.363796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.365489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:20.388491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:20.389397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:20.395685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:20.395685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:20.395685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:20.395685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:20.395685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 325/649] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:20.395685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.419893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.422036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.516903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f9679-f4ab-4b16-bc7e-8e76d6f8dadb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.526874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.541555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 325/650] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:20.541555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.542907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.554142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.555026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.555374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.555936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.567150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.568759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:20.586611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:20.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:20.588606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:20.588606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:20.588606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:20.588606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:20.588606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 326/651] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:20.589052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.650690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970fccc-06c5-4c4e-8216-7533609a511b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.687756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.688632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.688901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.689178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.690041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:20.690380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.691876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.694994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685c06-42b2-4e7d-bb45-1a2629ceb76f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.703514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 326/652] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:20.704357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.736274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.737339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.737857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.738422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.739346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:20.739858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.741422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.755002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 327/653] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:20.756200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.771087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.796961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:20.824674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2136215-faa8-478b-ab57-a3e65f43f4ff None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.865052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.865858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.866134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.866408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.879245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.880866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.889321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2f6f-b67c-4674-b5c9-2b1844df8bc8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:20.899636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:20.900532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:20.901422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:20.901422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:20.901422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:20.901422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:20.901422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 327/654] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:20.902226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:20.930103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:20.930773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:20.931080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:20.931353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:20.932141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:20.932452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:20.934105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:20.952000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 328/655] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:20.953019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.013673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fefd-4670-4dcd-afd0-7fe3eb993f3c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.022540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.054322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.056313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.057043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.057375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.057671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.058481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=aebe4b5d4c0c40218341971859875d67) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:21.058789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.060344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.062254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507745-5ee7-4e29-9388-e083fd5f3a8a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.067138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 328/656] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/role_assignments?user.id=aebe4b5d4c0c40218341971859875d67&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:21.068578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.107509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.108260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.108539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.108812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.121709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.123221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:21.145391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:21.146408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:21.147310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 329/657] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:21.147954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.222242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1afe5-6b98-430d-9dfc-7a513ab628db None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.268747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.268747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.269041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.269124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.270578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:21.270578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.272138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.285908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 329/658] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:21.286677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.289471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c187c-1111-402f-96f9-1aa43cbeff59 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.324766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.339222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.340081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.340362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.340640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.348287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.349740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a1d8eac5-542b-4187-87e6-cd8b57f3d34d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:21.364425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:21.365424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:21.366346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 330/659] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:21.366939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3188e6-c55a-4f6e-bc3f-7a6b4520c94c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.367192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3188e6-c55a-4f6e-bc3f-7a6b4520c94c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.367686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3188e6-c55a-4f6e-bc3f-7a6b4520c94c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.368836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 331/660] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:21.371841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3188e6-c55a-4f6e-bc3f-7a6b4520c94c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.391109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.407005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404186-5214-4c4a-ada8-2947cfd9ebab None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.446177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.446867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.447148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.447427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.448305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:21.448608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.450044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.468827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 330/661] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:21.470083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.490419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3188e6-c55a-4f6e-bc3f-7a6b4520c94c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.530363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.531242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.531603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.531773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.539463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.541268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1fa9f202-f91b-454e-b10d-c4a488bd9714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:21.555032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:21.555977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:21.556838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 332/662] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:21.558086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.558086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.558086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.568682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.575381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:21.576612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:21.584461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328f667-e42d-4523-88ff-3de1a9288090 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.622006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.622533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.622827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.623105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.623995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:21.624310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.625752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.645101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 331/663] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:21.645928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.655667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 333/664] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:21.656320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.665152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.764830 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d56ea-7791-4a21-b6a7-60b8f510c55a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.767478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01428-a3ce-4bbc-9d80-b10f857e8be2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.800475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.800835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.801113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.801384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.809089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.809771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.810057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.810336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:21.811137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:21.811450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.812929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.823145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.826684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 334/665] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:21.826684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:21.889682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:21.891194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:21.901104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:21.941294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c2fb7-bfb1-4e02-b599-1bee0d77c98a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:21.979130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:21.979817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:21.980201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:21.980393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.005572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 332/666] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:22.006697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.054679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.057001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.058531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.123760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cc05-78c4-4dce-afe4-010156fbe19f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.127975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.160756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.161620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.161927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.162177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.166397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 335/667] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:22.167071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.178726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:22.186763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:22.188005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:22.188870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:22.192923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 333/668] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:22.193762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.270405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3461-4be4-4142-88f2-010ad3c99b48 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.302823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eeae1-77a6-459f-ba01-3c9b7c151c41 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.308439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.309045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.309324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.309604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.310447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=5c6736109f3549eb85021ce2d6a23436) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:22.310597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.310762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.312241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.319970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 336/669] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/role_assignments?user.id=5c6736109f3549eb85021ce2d6a23436&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:22.328808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.342866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.343939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.344288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.345335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.360641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.362819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.376629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:22.388447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:22.389386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:22.390255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:22.390255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:22.390255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:22.390255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:22.392294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 334/670] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:22.393420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.464504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeafcc4-1350-41b9-b26a-a30ce36fb021 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.504638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.505592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.506007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.506379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.508342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336503-5be2-4749-be2c-a3eb541076de None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.520237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.521852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:22.543539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:22.544556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:22.545625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:22.545625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:22.545625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:22.545625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:22.545625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 337/671] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:22.546434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.557883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.559017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.559243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.559518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.560322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:22.560632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.562090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.572477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 335/672] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:22.573312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.598951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.676940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.696706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aebf8-c7d4-4225-94ce-bb15cad26d92 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.703011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88d42-0144-4d45-bed4-102645f70fe0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.731535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.732045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.732409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.732759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.733577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:22.733982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.735433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.748498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 336/673] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:22.753610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.756094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.757010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.757471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.757940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.758871 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:22.759365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.761396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.778626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 338/674] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:22.779768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.852268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:22.879992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40bbce-9a8c-47c9-88f4-2067032b4cf7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.924579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7610b6-38a1-4d04-a9a6-99276c1d613d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:22.930124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.930945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.931229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.931506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.945795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.947638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.964444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:22.965246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:22.965529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:22.965807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:22.972266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:22.973125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:22.973976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:22.973976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:22.973976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:22.973976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:22.977772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:22.978421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 337/675] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:22.979284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:22.979411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:22.998630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:22.999572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:23.000481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:23.004084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 339/676] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:23.004926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.008318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.100897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53e34-3e61-42d7-b14b-4ca34f09323c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.131880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.134220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18997-2eb2-4be2-a3c2-ef0ac30d3dd3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.139876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.140713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.140992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.141288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.154066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.156235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.173240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.173907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.174192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.174999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.175746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:23.176009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:23.177969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:23.180099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:23.181122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.181122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.181417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 338/677] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:23.181417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.191225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 340/678] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:23.196133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.263432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.310514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e6cae-de92-425b-b021-0ef2705d6187 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.315660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce294b-e4e1-4210-8b8d-11b57c95bfda None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.347007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.347673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.348020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.348260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.349048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:23.349358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.350964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.353540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.354275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.354583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.354859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.355691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:23.356037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.357587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5b4f1-3993-4e6e-9a21-3dfbf5ee38d4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.369763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 339/679] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:23.370860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.375697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 341/680] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:23.377086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ac7f6-f2af-43eb-b215-d4f104357d6b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.377370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ac7f6-f2af-43eb-b215-d4f104357d6b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.377691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ac7f6-f2af-43eb-b215-d4f104357d6b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.378964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 342/681] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:23.379647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ac7f6-f2af-43eb-b215-d4f104357d6b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.430764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.480723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe23af8-f07b-40e1-8055-daf8edc8a104 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.489420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ac7f6-f2af-43eb-b215-d4f104357d6b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.514519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.517894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.518951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.519238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.519581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.527574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.528262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.528543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.528790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.528904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.529627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=92f96e51cfa14f148a5dd3ebd18f591c) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:23.529961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.530822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.531377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.538223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 343/682] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/role_assignments?user.id=92f96e51cfa14f148a5dd3ebd18f591c&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:23.539052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-500d8e4b-290f-4d0e-87ba-1fc821a4c213 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:23.554239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:23.555500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:23.556801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:23.564844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 340/683] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:23.566816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.567097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.567367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.586811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:23.588164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:23.679264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b132c63-239a-42f3-a35f-0d011b6eca0e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.684668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 341/684] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:23.685955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.731078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.732203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.733159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.733667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.734785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.736386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=e8fa8ef7d61f483db27148b5e316db3c) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:23.737259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.740353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.749332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 344/685] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/role_assignments?user.id=e8fa8ef7d61f483db27148b5e316db3c&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:23.750351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.815759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8cc48-6cec-4b5e-aa21-020d2bda4b03 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.836432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:23.872090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.872871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.873155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.873432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.874290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:23.874603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:23.876830 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:23.906790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 342/686] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:23.913432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:23.914535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1230d9-aa86-477c-9d2e-203c64df28af None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:23.962151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:23.963451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:23.972005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:23.972005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:23.978495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:23.996651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:23.997661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:23.998503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:24.003859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 345/687] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:24.005996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.039153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:24.043072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719d2b3-d93c-443d-bc71-a45bfd143538 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.084774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:24.085471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.085750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.086026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.142794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a65f09-d880-4489-9d31-7af8ff3fc5ba None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.156106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:24.197929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:24.199132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.199999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.200930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.204082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:24.206088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:24.207747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:24.235618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 346/688] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:24.237584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.291602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:24.293096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:24.393987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb20a6f-796c-41a8-b346-691aae6d9555 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.430049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:24.436838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 343/689] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 09:23:24.448766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.476350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:24.477411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.477843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.478297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.499604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:24.501300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:24.545695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:24.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:24.547879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:24.547879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:24.547879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:24.547879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:24.547879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 347/690] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:24.557082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.587211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e5ee-e1f7-49f5-b89c-1ae02c5dc3c1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.628705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:24.641558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:24.642678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.644568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.645039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.665159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:24.666924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-095a854d-3490-46d5-a247-a2ba26d839da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:24.687115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:24.688106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:24.688980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:24.688980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:24.688980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:24.688980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:24.691157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 344/691] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:24.696921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb986-8b71-420d-9c31-c01e45c9b1f8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.697568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb986-8b71-420d-9c31-c01e45c9b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.698004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb986-8b71-420d-9c31-c01e45c9b1f8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.699774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 345/692] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:24.700640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb986-8b71-420d-9c31-c01e45c9b1f8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.730952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d334-1e99-4b9a-9c14-6f7f5cec4430 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.757715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:24.772139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:24.772977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.773265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.773546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.774546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:24.774740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:24.776150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa14d7-157c-4f19-8f5c-4602cd7d8ea9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:24.789643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 348/693] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:24.791012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.791306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.791586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.810542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:24.811667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:24.813968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb986-8b71-420d-9c31-c01e45c9b1f8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.854133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:24.855101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:24.855565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:24.856155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:24.857091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:24.857581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:24.859137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:24.871921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 346/694] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:24.872981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.890319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 349/695] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:24.891188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:24.922743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:24.981655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cd6f-2db6-416b-9282-a6972d1f555f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:24.995511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.020494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.021647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.022136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.022614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.023215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02285d-350f-4715-9667-d8475287cf4d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.031463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.033320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:25.049636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:25.050621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:25.051541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:25.054377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 347/696] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:25.055495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.062116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.062944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.063230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.063504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.073958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.075625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:25.095814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:25.096786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:25.097661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:25.098598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 350/697] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:25.099038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.166037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bac3db-52d0-4eb1-ad03-5b4720f35490 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.201439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.203746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.204973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.205493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.206264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.218248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.220186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.232388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07ace-f9d4-4561-b428-deae7ee10fb7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:25.239381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:25.240251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:25.241141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:25.241141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:25.241141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:25.241141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:25.243307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 348/698] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:25.244343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.272494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.279204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.279936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.280228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.280510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.281530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:25.281848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.284486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.304609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 351/699] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:25.305735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.377254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356688d-c475-44b2-b412-038fb3547fe0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.411197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690555-f337-49d7-bb30-4db1e0bacf40 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.426507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.427187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.427475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.427789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.428866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:25.429185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.431387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.449354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.450320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 349/700] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:25.451368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.458884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.459929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.460448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.460928 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.461968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:25.462497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.464158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.477165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 352/701] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:25.478298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.558299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.580458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae68b-0631-4587-8d8f-b05f16bd5df0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.617488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364920-86f0-4161-9c9c-dba558aab1dc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.618059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.618720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.619004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.619283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.670817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.672229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.672983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.673468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.674921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=92eaddc698594f328d27c7e3c7bf6a02) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:25.675447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.677678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.687478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 353/702] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/role_assignments?user.id=92eaddc698594f328d27c7e3c7bf6a02&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:25.688658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.694976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.696379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.772293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.816194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:25.844539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 350/703] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:25.850646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:25.870920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fa04c-a2f6-4650-aacd-26894c2b0d67 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:25.939547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:25.940793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:25.941112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:25.941401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:25.942122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:25.944867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:25.969910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 354/704] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:23:25 2022] POST /identity/v3/users => generated 254 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:25.984595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9dfe-e687-4f27-a350-444352980ee8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.026857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.027839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.028123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.028443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.042757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.044317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-88f34733-e54c-44a5-a62f-cd4b41c44db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:26.065913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:26.066899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:26.067814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:26.067814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:26.067814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:26.067814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:26.067814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 351/705] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:26.073253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.093765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8d4d-cd1c-4323-ab31-4831842961d6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.094099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8d4d-cd1c-4323-ab31-4831842961d6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.094309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8d4d-cd1c-4323-ab31-4831842961d6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.096065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 352/706] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:26.101806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df15e-2732-46f6-ae2c-5901a7a213b4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.102103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df15e-2732-46f6-ae2c-5901a7a213b4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.102354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df15e-2732-46f6-ae2c-5901a7a213b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.121143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-991df15e-2732-46f6-ae2c-5901a7a213b4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:26.122381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-991df15e-2732-46f6-ae2c-5901a7a213b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:26.166875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:26.210260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ceeb-a26f-419a-a222-d9a25a3ecbc4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.219375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 353/707] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:26.221172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24946e4-02f0-493e-b3db-38a56aa7e510 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.222024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24946e4-02f0-493e-b3db-38a56aa7e510 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.222307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24946e4-02f0-493e-b3db-38a56aa7e510 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.224665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 354/708] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:26.229838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.230094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.230334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.236063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:26.258055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:26.259940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:26.260346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.261104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.261473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.261653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.262392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:26.262953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.264457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.278820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 355/709] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:26.279688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.359440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 355/710] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:26.361385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.393988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af68e2-045f-4bcc-a5e6-3331b6319ab7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.430515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.431327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.435746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.435746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.435746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.435746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:26.450002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:26.451056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:26.456453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 356/711] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:26.458314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.484168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:26.493234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522c81e-6aa0-4666-8b6e-d8616ac88c86 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.500074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:26.538844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.539953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.540246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.540525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.550556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.552355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:26.568749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:26.569782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:26.570711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:26.573574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 356/712] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:26.574637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.578962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9913d-9f0e-49f8-a11a-7df678576320 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.624193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.625395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.625755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.626108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] PATH_INFO: `/v3/services/network` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.627130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.629366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:26.645310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:26.646415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:26.647241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 357/713] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:26.648057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.687249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfe8a0-f745-4e1d-bb1a-44f2f88ec18a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.734548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.735230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.735513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.735813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.736533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:26.736874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.738278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.748341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 357/714] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:26.748341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.770986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:26.774648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6283-e7ee-4427-8e70-6d6a247a9127 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.775486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:26.821761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.822825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.823381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.829834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.831612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:26.832211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.833931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.848370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 358/715] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:26.849646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.876855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415e4a9-8efc-418d-9f0b-614fed3f0892 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:26.912755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:26.913432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:26.913719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:26.913999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:26.914709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] RBAC: Adding query filter params (name=network) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:26.915035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:26.916531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:26.921234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 358/716] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:26.922042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:26.967173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7186ed9-c4d0-4cbe-a732-273dfb5328a6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:27.006192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:27.007180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:27.007982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:27.008232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:27.009306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:27.010297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:27.010884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:27.013550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:27.028005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd74d-7e32-48a6-9eb7-4e28c124541b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:27.028501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 359/717] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:27.029674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:27.063978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:27.064660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:27.064986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:27.065305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:27.066498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=aebe4b5d4c0c40218341971859875d67) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:27.066498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:27.067931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9168f1-bf51-4a58-8443-ce8b39212b3e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:27.074219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 359/718] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:26 2022] GET /identity/v3/role_assignments?user.id=aebe4b5d4c0c40218341971859875d67&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:27.079754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:27.218833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbc61b-8a7f-4e79-a844-a915afa5497e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:27.274100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:27.275162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:27.275672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:27.276194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:27.277203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:27.277784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:27.279397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888eae1-a044-4d75-beee-594c0cd0ab52 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:27.286110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 360/719] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:28.233586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8539-b39c-4413-951e-ba90f888c693 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.234098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8539-b39c-4413-951e-ba90f888c693 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.234198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b8539-b39c-4413-951e-ba90f888c693 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.235812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 360/720] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:28.250269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5457b-e702-403a-ba06-150f3de4f123 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.250752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5457b-e702-403a-ba06-150f3de4f123 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.250950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5457b-e702-403a-ba06-150f3de4f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.280701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-51a5457b-e702-403a-ba06-150f3de4f123 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:28.281952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-51a5457b-e702-403a-ba06-150f3de4f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:28.369512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 361/721] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:28.416438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8539-b39c-4413-951e-ba90f888c693 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:28.453449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15bbd8-b24d-4439-a4a1-71b8e71c19f5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.453792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15bbd8-b24d-4439-a4a1-71b8e71c19f5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.454049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15bbd8-b24d-4439-a4a1-71b8e71c19f5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.457463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 362/722] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:28.462163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.462454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.462737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.491739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:28.493930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:28.519317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:28.577143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b8539-b39c-4413-951e-ba90f888c693 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:28.620818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 363/723] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 09:23:28.641577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:28.642386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.642671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.642950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.647016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:28.660681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:28.670478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:28.671377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:28.672244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:28.674003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 361/724] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:28.677535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:28.693228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:28.847329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75617ff9-2fe7-4433-bd7e-9aa2316e96a4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:28.859477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa5d8a-07cc-468f-bf4f-707e5e6e3fa8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:28.903590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:28.904485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.904771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.905047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.905803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:28.906121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:28.907493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:28.920006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:28.920820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:28.921105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:28.921383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:28.926270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 362/725] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:28.932259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:28.957327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:28.968584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:28.969597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:28.970431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:28.973416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 364/726] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:28.977715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.012072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.047331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.104881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fefd1-7dd1-4f31-9f8a-af74fe59f103 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.155765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac7a64-2167-4c0f-9301-3e52d43efe89 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.180449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.181279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.181567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.181849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.192083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.192891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.193296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.193671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.194531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:29.194940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.196460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.206675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.209372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.216813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 365/727] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:29.224686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:29.232692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:29.233565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:29.234863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:29.234863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:29.234863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:29.234863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:29.239224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 363/728] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:29.240433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.371363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.391555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0772bf-d408-413f-b4d2-031f7d87f1be None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.418058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.434471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.435542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.435959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.436360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.437716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:29.439094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.440528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.442242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b8427-7a25-46cb-af71-9a7cb9467de9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.459853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 364/729] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:29.461431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.525919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.526736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.527020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.527296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.552556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.554022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b25681a3-687d-404b-b4f8-426517d2d3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:29.585030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:29.585968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:29.586839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:29.586839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:29.586839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:29.586839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:29.587308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 366/730] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:29.592662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80ac1-e29d-40ad-aa09-6d41e82fb23b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.593055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80ac1-e29d-40ad-aa09-6d41e82fb23b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.593503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80ac1-e29d-40ad-aa09-6d41e82fb23b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.599003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 367/731] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:29.600031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80ac1-e29d-40ad-aa09-6d41e82fb23b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.611012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4b7a6-c68b-4b14-8a5b-a105a7df98b1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.657651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.658387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.659206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.660071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.670986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.672480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0dcbe7ca-75c1-4a21-9e56-080f9c5bba51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:29.693704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:29.695686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 365/732] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2851e-d931-45c0-972c-c387416cf6f9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.697732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2851e-d931-45c0-972c-c387416cf6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.699308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2851e-d931-45c0-972c-c387416cf6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.719083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80ac1-e29d-40ad-aa09-6d41e82fb23b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.724678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b1f2851e-d931-45c0-972c-c387416cf6f9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:29.725960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b1f2851e-d931-45c0-972c-c387416cf6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:29.743084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.756724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.757397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.757684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.757968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.758706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:29.759020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.760467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.766730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.774625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 368/733] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:29.775786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.802876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 366/734] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:29.804572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17442-5171-40dd-a8c1-8ff912ac57f6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.805073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17442-5171-40dd-a8c1-8ff912ac57f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.805589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17442-5171-40dd-a8c1-8ff912ac57f6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.807088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 367/735] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:29.808001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17442-5171-40dd-a8c1-8ff912ac57f6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:29.905578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab428ba-c5d4-419d-855a-972aeff50823 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.924117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17442-5171-40dd-a8c1-8ff912ac57f6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:29.941162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.941835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.942119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.942397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.943239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:29.943551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.945008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674299f2-ad63-45c2-8cfe-9cdb81c52d6c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.960206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:29.961028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.961313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.961585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.962807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 369/736] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:29.964050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c94d04-67e6-44d5-a3c0-080a605c18cc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:29.964345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c94d04-67e6-44d5-a3c0-080a605c18cc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:29.964615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c94d04-67e6-44d5-a3c0-080a605c18cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:29.969096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:29.970548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:29.981418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d5c94d04-67e6-44d5-a3c0-080a605c18cc None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:29.982606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d5c94d04-67e6-44d5-a3c0-080a605c18cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:29.986259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:29.987273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 368/737] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:29.988257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.020079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.023495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.067740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 370/738] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:30.067740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d9c5d-3e34-486f-98d9-da372601b511 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.067740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d9c5d-3e34-486f-98d9-da372601b511 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.067740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d9c5d-3e34-486f-98d9-da372601b511 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.067740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 371/739] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:30.067740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d9c5d-3e34-486f-98d9-da372601b511 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.097090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86648261-a93b-46d2-9d74-2e634e40b827 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.130311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.131107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.131391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.131669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.141942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:30.150166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:30.151096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 369/740] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:30.152144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.176741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d9c5d-3e34-486f-98d9-da372601b511 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.211197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.211872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.212158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.212430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.250640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.251178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.260528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339fb25-0e79-4f21-bee9-aa3eada1bcb6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.285330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.287357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.301415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.302201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.302558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.302904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.303855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:30.304238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.305732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb93ebc-8d61-4614-8706-b40e7a6834e0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.323598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 370/741] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 20 09:23:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:30.324661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292cef-7d31-46e0-bb56-26775194542d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.324952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292cef-7d31-46e0-bb56-26775194542d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.325234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292cef-7d31-46e0-bb56-26775194542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.341944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-60292cef-7d31-46e0-bb56-26775194542d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:30.343165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-60292cef-7d31-46e0-bb56-26775194542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:30.405408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 372/742] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:30.406316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.410021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 371/743] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:30.410861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60292cef-7d31-46e0-bb56-26775194542d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.479614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.493292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.511632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b26f-d423-444d-87a8-0955506e4b85 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.513125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60292cef-7d31-46e0-bb56-26775194542d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.545944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.546615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.546904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.547078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.547195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.547760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.547926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.548028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.548299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.549038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:30.549845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.549958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.551195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.564449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 372/744] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:30.564449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.569203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 373/745] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:23:30 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:30.570040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.709462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b96b-3235-456e-9829-5d49bea3e939 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.738548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.748648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.749453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.749733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.750005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.761766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.763494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:30.785169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:30.786118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:30.787027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:30.787027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:30.787027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:30.787027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:30.787027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 374/746] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:30.787764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:30.801009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0e11-f84f-4eeb-bdb4-a811eb146846 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.843091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.844019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.844224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.844464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.857860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:30.895539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc9fdf-024d-425b-bf3c-510fc3001657 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:30.924566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.925995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.930707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:30.931651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:30.931993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:30.932298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:30.933126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:30.934608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:30.948908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 375/747] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:23:30 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:30.950220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.000740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.080426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 373/748] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:31.081656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.094054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3801155-d853-4f8e-ae31-ed4c441dfa11 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.138441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.143816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.143989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.144594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.144594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.159049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.161040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:31.191497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:31.192810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:31.193925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:31.193925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:31.193925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:31.193925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:31.193925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 376/749] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:31.195365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.212462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d97a-ae06-495c-80aa-3114be2aa0a5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.252833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.254239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.254706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.255173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.256139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:31.256630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.258178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.271276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 374/750] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:31.272493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.322853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.347361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9e669-2dc9-4c48-baa7-5fced73c33c9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.385914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.387147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.388096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.388583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.394771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96a0b2-beb4-4cec-a463-8a6187b07646 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.396274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.401870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.403588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:31.421978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:31.423342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:31.424810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:31.424810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:31.424810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:31.424810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:31.427110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 377/751] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:31.428167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.441873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.442547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.442828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.443101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.444281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:31.444583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.446244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.463846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 375/752] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:31.465011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.547182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aa547-8cc8-49e2-9ace-a595d2e01d04 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.589138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d9bff-2385-4a36-9bc6-dbd13eb3f022 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.594757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.595847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.596434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.597439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.608382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.609894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.621533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.639254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.639981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.640260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.640561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.641251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:31.641554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:31.642295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:31.643195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:31.644090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:31.644504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.651961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 378/753] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:31.652721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.665657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 376/754] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:31.665657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.695507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.764293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963d208-b56f-4ac3-8cbf-e1e1165cbf8f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.792403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8aa38-5b60-4f32-a5ba-d655151c1c66 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:31.811244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.812068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.812353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.812666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.823159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.824960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.839386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:31.840327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:31.840786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:31.841325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:31.842282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:31.842762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:31.843547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:31.844450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:31.845507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 379/755] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:31.846914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.848397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:31.871360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 377/756] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:31.871360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:31.927086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.973441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:31.985161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9bda-1fd8-42e7-b1b0-0636d8771189 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.007215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1222bff-d77d-435d-bcb2-0f79431f6d63 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.028600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.029391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.029678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.029957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.037797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.039315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.048384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.049931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.050418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.050894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.051982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:32.052493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.054113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:32.054454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:32.055318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:32.056224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:32.060423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 380/757] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:32.061321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.076461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 378/758] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:23:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:32.077590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.170761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb664-9c62-4764-a505-1ff14d1e7022 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.190102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:32.191074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4be0-06de-4318-a78a-0da016bbcbcb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.211562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.212177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.212464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.212743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.213678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=92eaddc698594f328d27c7e3c7bf6a02) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:32.213929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.215461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.232010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 381/759] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/role_assignments?user.id=92eaddc698594f328d27c7e3c7bf6a02&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:32.233271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.235887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.236949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.237483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.237957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.238950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:32.239459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.241175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.251407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:32.258544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 379/760] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:32.267257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.387932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06000ef9-46cd-422f-95c2-6b88a68105d4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.416813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af7bc-ace9-4f6f-bba8-26bd63e398f0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.453261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.454300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.454757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.455283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.458283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.458283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.458283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.458283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.460155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=81e2cdcf476e40039b7839b529f0ebeb) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:32.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.462510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.475750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.475750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.478813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 380/761] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/role_assignments?user.id=81e2cdcf476e40039b7839b529f0ebeb&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:32.496382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:32.497336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:32.498201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:32.498201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:32.498201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:32.498201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:32.498201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 382/762] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:32.503980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.590382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:32.651425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c8841-a835-456f-bc4f-d4cfec846f99 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.698707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.699392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.699681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.700161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.700902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:32.701213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.702581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4d2f-dccf-4a20-973f-3968d286d8ef None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.715572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 381/763] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:32.721452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.785775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:32.824825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940420b2-c090-445a-8da1-8c01e56581b3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.825116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940420b2-c090-445a-8da1-8c01e56581b3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.825399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940420b2-c090-445a-8da1-8c01e56581b3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.826912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 382/764] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:32.834441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.834796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.835150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.852162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:32.853455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:32.869460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572b725-22ae-4879-875f-0c706932e99f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:32.916801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:32.917557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:32.917844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:32.918125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:32.933210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:32.934588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:32.938996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 383/765] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:32.961006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:32.962606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:32.964179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:32.967979 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 383/766] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:32.968681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:32.979960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.052112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:33.092003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f978d-1d39-4dff-a107-4b6afd848b15 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.129114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.130206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.130790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.131261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.132392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:33.132903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.134537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.149004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 384/767] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:33.156890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.159181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:33.175826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b8a7-1783-484e-ac13-e575571dba1e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.206961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.208103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.208388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.208664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.209321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.210912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ab6d337a-abb4-4f1b-bd91-976fa410aebf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:33.224238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:33.225192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:33.226002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 384/768] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 20 09:23:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:33.227319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b124-ad7f-4950-ae06-e77e846cdf1b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.227319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b124-ad7f-4950-ae06-e77e846cdf1b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.227489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b124-ad7f-4950-ae06-e77e846cdf1b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.234204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 385/769] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:33.234976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9b124-ad7f-4950-ae06-e77e846cdf1b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.289728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188a3c-7af2-4482-a49c-edcdd03efefa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.308931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:33.327669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1de81-d40d-4fc2-ae89-1bb0d5f91e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.328851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1de81-d40d-4fc2-ae89-1bb0d5f91e98 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.329324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1de81-d40d-4fc2-ae89-1bb0d5f91e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.329736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1de81-d40d-4fc2-ae89-1bb0d5f91e98 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/aebe4b5d4c0c40218341971859875d67/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.333193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1de81-d40d-4fc2-ae89-1bb0d5f91e98 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=aebe4b5d4c0c40218341971859875d67, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.334994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1de81-d40d-4fc2-ae89-1bb0d5f91e98 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.349373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9b124-ad7f-4950-ae06-e77e846cdf1b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.352440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 385/770] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:33 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/aebe4b5d4c0c40218341971859875d67/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:33.353974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.354438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.354879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.374931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:33.376617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:33.391498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.392290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.392663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.393008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.393799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:33.394104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.395582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.401291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 386/771] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 20 09:23:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:33.413166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.460333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:33.462477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 386/772] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:33.498341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.548846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea2d1-dcfa-4e52-8fd2-190a3b6f5fe5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.588736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.589399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.589686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.589968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.590760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:33.591072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.592608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.600653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 387/773] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 20 09:23:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:33.615756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.650029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0654d6-470d-492f-a1ec-9172a4f22c6c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.652629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:33.703378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.704675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.705144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.705660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.706508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.710123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:33.712256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.726421 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29268ba-5fe0-4a94-bfe0-50b32e01f741 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:33.737367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:33.738628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:33.739492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 387/774] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:33 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:33.744440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.770983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.772011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.772534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.772953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.773996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] RBAC: Adding query filter params (interface=public, service_id=1f2d76b526b04096892dc534858b1cea, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:33.774475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.776098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.784734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 388/775] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:23:33 2022] GET /identity/v3/endpoints?service_id=1f2d76b526b04096892dc534858b1cea&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:33.790322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:33.904192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d0e5-6e3e-4069-910f-0478b61cff9e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:33.948623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:33.949322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:33.949608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:33.949888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:33.950595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:33.952021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:33.962544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 389/776] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:23:33 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:33.967918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046be24-11ef-4ccb-a99d-9df57e3951b6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:34.009572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:34.010272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:34.010558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:34.010840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:34.011662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] RBAC: Adding query filter params (name=network) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:34.012012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:34.013766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:34.020372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 388/777] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:34.028916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:34.056098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:34.148026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a151fa-de35-40e9-ac97-6063d81b2a9f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:34.197282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:34.197963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:34.198250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:34.198529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:34.199242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:34.199556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:34.200971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:34.207067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 390/778] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:34.212536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:34.247863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:34.326329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923709d-8376-4818-8207-6d8232b85909 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:34.366262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:34.366939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:34.367264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:34.367544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:34.368434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] RBAC: Adding query filter params (interface=public, service_id=9c23323036194189b13c77fe56e8fa08, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:34.368752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:34.370239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facbd01-e175-4c94-b62b-cbe8dfac92c2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:34.380712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 389/779] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:23:34 2022] GET /identity/v3/endpoints?service_id=9c23323036194189b13c77fe56e8fa08&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:34.388641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:34.507413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:34.530380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0934-b654-4cce-83ed-9f2774ab18e2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:34.577559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897308eb-ca97-46b5-9d2d-d03fc5e210a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:34.578237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897308eb-ca97-46b5-9d2d-d03fc5e210a0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:34.578521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897308eb-ca97-46b5-9d2d-d03fc5e210a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:34.578803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897308eb-ca97-46b5-9d2d-d03fc5e210a0 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:34.579488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897308eb-ca97-46b5-9d2d-d03fc5e210a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:34.581441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897308eb-ca97-46b5-9d2d-d03fc5e210a0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:34.592705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 391/780] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:23:34 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:34.971606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95996-7515-4330-b184-75455d78b4dc None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:34.971991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95996-7515-4330-b184-75455d78b4dc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:34.972196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95996-7515-4330-b184-75455d78b4dc None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:34.973891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 390/781] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:34.978977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c1dcd-683b-4f6e-a824-deb169048bdd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:34.979267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c1dcd-683b-4f6e-a824-deb169048bdd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:34.979552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c1dcd-683b-4f6e-a824-deb169048bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.004754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8b2c1dcd-683b-4f6e-a824-deb169048bdd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:35.005957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8b2c1dcd-683b-4f6e-a824-deb169048bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:35.076839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 392/782] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:35.112019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95996-7515-4330-b184-75455d78b4dc None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:35.227666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:35.241383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95996-7515-4330-b184-75455d78b4dc None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:35.260898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a243-8880-4234-8d26-0aa64d0af431 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:35.261260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a243-8880-4234-8d26-0aa64d0af431 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:35.261610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a243-8880-4234-8d26-0aa64d0af431 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.267418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 393/783] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:35.269235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:35.269586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:35.269932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.287635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:35.288696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:35.289063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:35.289504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:35.289783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:35.290056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.308478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:35.316767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:35.317669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:35.318856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 391/784] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:35.323943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:35.428748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 394/785] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:35.458293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:35.464154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:35.466487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda88fc8-88d9-4c3b-9020-afd043823d3e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:35.538078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:35.538809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:35.539089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:35.539357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.540128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:35.540429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:35.541785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:35.559894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 392/786] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:35.566411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:35.609529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcb3f6-42c0-478c-b0f3-349ce60c32bb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:35.618701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:35.667485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:35.668370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:35.668652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:35.668968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.696962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:35.715743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:35.716767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:35.718071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 395/787] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:35.724663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:35.739705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4285b-d266-4c93-bfe4-11032ef18d9d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:35.775549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:35.776440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:35.776763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:35.777035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:35.789149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:35.790586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:35.811495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:35.812825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:35.813698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:35.813698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:35.813698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:35.813698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:35.813698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 393/788] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:35.816958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:35.857198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:35.893445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:35.952756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91c97-81c6-4d28-b407-f9befb886f41 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:35.956809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa501-5b0d-4d52-b8c1-2a5461e48c7b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:35.999173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:35.999881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.000213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.000486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.001213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:36.001567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.002991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.016439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 394/789] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:36.023079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.073074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.073769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.074052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.074326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.075092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:36.075402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.076829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0d925-0465-472d-a36a-3bbdd810f143 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.086864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 396/790] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:36.088412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4ece3-871f-4edc-8f6e-2a232195eaa2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.088704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4ece3-871f-4edc-8f6e-2a232195eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.088984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4ece3-871f-4edc-8f6e-2a232195eaa2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.090730 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 397/791] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:36.092417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4ece3-871f-4edc-8f6e-2a232195eaa2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.133136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae35414-a528-4e81-a64e-dcf1e40131c2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.164776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:36.171370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.172381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.172661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.172932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.181006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.182644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7a0e20f2-22cc-4351-bb9e-df92b8435eeb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:36.199336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:36.200467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:36.201458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 395/792] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:36.202185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.202374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.202648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.210590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4ece3-871f-4edc-8f6e-2a232195eaa2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.226719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:36.227960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:36.237188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:36.250573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.251651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.252672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.253154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.269950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.271445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:36.291100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:36.292092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:36.292950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:36.292950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:36.292950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:36.292950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:36.297174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 398/793] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:36.298076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.310331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 396/794] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:36.311425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.416653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80369fa5-8d7a-4184-8319-7207277f565f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.431044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48052d-304b-4863-a648-9233fb308474 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.440666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:36.454536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.456249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.456756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.457273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.458194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:36.458875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.460667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.467898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.468780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.468892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.469117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.469960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:36.470269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.471753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.475375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 397/795] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:36.476802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.495095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 399/796] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:36.499925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.531422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:36.591557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60164500-e54b-450b-a911-00e5ba5ccf51 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.600944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ba48-d86a-4aab-b152-4aacf112fc90 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.630987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.632778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.633546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.634020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.638271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.639106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.639619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.640038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.646358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:36.648854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.650321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:36.653997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:36.655025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 398/797] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:36.661650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-afe69108-3516-4f4e-af49-f76d88b752b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:36.667769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:36.668678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:36.669592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 400/798] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:36.675171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885fb7-c2cd-45b4-a627-3df78b03da66 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.675171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885fb7-c2cd-45b4-a627-3df78b03da66 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.675171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f885fb7-c2cd-45b4-a627-3df78b03da66 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.675171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 401/799] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:36.675171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f885fb7-c2cd-45b4-a627-3df78b03da66 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.709859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:36.772048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6646f8-2220-4ff5-ba6a-32c955107110 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.777566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:36.786475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f885fb7-c2cd-45b4-a627-3df78b03da66 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.813489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.814287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.814632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.814909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.828334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:36.828526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.829015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.829300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.829577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.830857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.830946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:36.831172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:36.832529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:36.847324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 402/800] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:36.847324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8e7314cf-d21a-4bf9-964a-94ac4dee72e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:36.848413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:36.849241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:36.850116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:36.850116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:36.850116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:36.850116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:36.851110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 399/801] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:36.853582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:36.854095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:36.854562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:36.873789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:36.874973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:36.943774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 400/802] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:36.948572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:36.961597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926bce-be87-4df6-9984-5d8e2d3cab59 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:36.977773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.005548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.006227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.006507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.006784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.007626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.008493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.009926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.034316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 403/803] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.034316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.050734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.062936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169ff8c-d2c2-49d2-a8bf-b9f110c78830 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.100298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.101102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.101374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.101639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.112303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.114115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:37.132936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:37.133854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:37.134996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:37.134996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:37.134996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:37.134996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:37.134996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 401/804] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:37.134996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.141264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8f5f-a832-45ef-a4fd-543ef05a965e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.176213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.176885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.177175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.177455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.178188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.178496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.179891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.191619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 404/805] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.192449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.209901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.234463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd50c-201f-4df8-ac20-bda59ca9307a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.268583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.269396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.269680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.269955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.270277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.270618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.272086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ac191a0c-cbfb-41b4-900b-acd9a132c178 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:37.284471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:37.285395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:37.286217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 402/806] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:37.287102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a85eed-9780-4bbe-9fc2-4474091db3aa None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.287443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a85eed-9780-4bbe-9fc2-4474091db3aa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.287663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a85eed-9780-4bbe-9fc2-4474091db3aa None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.289078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 403/807] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:37.289635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a85eed-9780-4bbe-9fc2-4474091db3aa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.301011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bac2f-256a-4284-8596-dbfa69ae6d77 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.334495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.335297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.335584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.335894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.347845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.349330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:37.367314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:37.368363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:37.369451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:37.369451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:37.369451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:37.369451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:37.369451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 405/808] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:37.370681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.396183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a85eed-9780-4bbe-9fc2-4474091db3aa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.434890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.435569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.435884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.436161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.436964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.437353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.439011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.445992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.457089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 404/809] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.457089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.479050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc86b-1d85-4acf-8d3a-bea9e0907292 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.504046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.513360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.514067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.514352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.514629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.521867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.523403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9a2cd769-0909-43af-adaf-cbed30605efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:37.538844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:37.539905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:37.540776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 406/810] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:37.541278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.541563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.541842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.558562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:37.559648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd050395-9786-46c4-8536-9fca1676c28d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.560108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:37.593068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.593732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.594015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.594291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.594994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.595302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.596771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.601491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 405/811] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.601926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.627474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 407/812] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:37.628355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.681426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.720469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e5643-09e5-4cd9-9b34-095f2f788c23 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.731469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6261f6-52cb-41fe-b587-afdc2ce5837c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.748527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.755029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.755689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.755995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.756271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.756981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.757282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.758632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.767222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.768084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.768369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.768650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.770651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 406/813] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.771640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.776513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.778000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:37.793290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:37.794411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 408/814] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:37.795520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.878083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113433-c296-4ef2-933d-0e84b214bddf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.898623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570d575-d2c7-4436-ac92-e5236ffd91b1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:37.901628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:37.913631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.914324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.914601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.914872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.915653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.916043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.917489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.929306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 407/815] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.930136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.933780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:37.934594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:37.934897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:37.935169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:37.935905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:37.936213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:37.937570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:37.942727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 409/816] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:37.943491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:37.984194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.032753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a4de8-08fc-4c2b-b9d2-d3196c76d394 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.042216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466dfa-e8b1-48c4-b78a-8b3c91274708 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.066080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.066805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.067088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.067363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] PATH_INFO: `/v3/services/network` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.068049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.069411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.075801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.076594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.076877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.077153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:38.081719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:38.082825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:38.083992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 408/817] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:38.084968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.086806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.088858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:38.104251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:38.105297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 410/818] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:38.106473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.136034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.191673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e527-6917-457e-a9b0-e75b6143bb5a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.205690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.209415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f7687-9876-4b97-ba41-955307c47c86 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.224405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.225072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.225356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.225633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.226480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:38.226793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.228268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.244977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.245875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.245983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 409/819] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:23:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:38.246156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.246431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/92eaddc698594f328d27c7e3c7bf6a02/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.246805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.251937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=92eaddc698594f328d27c7e3c7bf6a02, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.254073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.271028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 411/820] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:38 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/92eaddc698594f328d27c7e3c7bf6a02/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:38.272152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.390561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3c434-3db2-4565-b885-c85441427f38 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.390903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cbb1b-bc33-4137-8e78-c729bf640e1c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.393831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.429036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.429713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.429998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.430228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.430366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.431009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.431110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.431426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.431826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.432408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.434201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] RBAC: Adding query filter params (name=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:38.434201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.435531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.445480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 412/821] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:38.446465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.461225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 410/822] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:23:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:38.462081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.482627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.589537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52b3d-f2e1-428e-8c9f-f8c53c808a20 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.612176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3babb-8e03-4611-bad3-09ffef7eec66 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.635554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.636287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.636574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.636853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.637900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:38.638212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.639650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.651974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.652585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.652693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 413/823] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:38.652864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.653121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.653444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.684581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.748256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.749995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.754813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.775255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f73f-e8de-4773-9f75-f3ac11f43e1d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.816799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.817615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.817968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.818313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:38.819096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:38.819471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:38.821112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:38.832753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 414/824] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:38.833874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.889326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 411/825] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:23:38.890398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:38.958543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5acc-80e0-47f9-a6d7-496db7371215 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:38.968249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:38.997259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:38.998408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:38.998854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:38.999278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/81e2cdcf476e40039b7839b529f0ebeb/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.018570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=81e2cdcf476e40039b7839b529f0ebeb, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.020059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:39.025668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34157a-c806-4cb8-aa2c-4fea1e5c381c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:39.030113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:39.037809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 415/826] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:38 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/81e2cdcf476e40039b7839b529f0ebeb/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:39.038822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:39.068824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:39.069944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:39.070443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:39.070898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.071889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.073530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:39.108017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 412/827] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:23:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:39.182143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761c030-f4ad-4de9-b82e-cf5fc2c5eca2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:39.234737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:39.235488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:39.235804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:39.236083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.248450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.249931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:39.270490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:39.271452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:39.272367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:39.272367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:39.272367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:39.272367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:39.272367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 416/828] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:39.278090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:39.401839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82599e1-a209-40e3-b206-f597a1a0c011 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:39.415273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:39.446927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:39.447618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:39.447960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:39.448238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.448976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:39.449287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.450659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:39.467309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 413/829] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:39.472939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:39.527026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:39.589732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1bdee-21eb-4220-bf59-32fd8e58a026 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:39.629034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:39.629846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:39.630129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:39.630404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.640489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.642134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:39.660977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:39.661924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:39.662874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 417/830] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:39.668355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:39.782763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89526a-529c-4bfc-b4f4-5ea47f0d20ce None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:39.821578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:39.822258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:39.822544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:39.822825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.823623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:39.823966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.827032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a62b3-6f77-4736-a0ef-94a6e1e9e0b4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:39.838709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 414/831] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:39.844674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:39.958644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627436-545a-4c6c-9ca9-3c19b296c63a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:39.965912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:39.994498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:39.995197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:39.995481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:39.995840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:39.996678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=aebe4b5d4c0c40218341971859875d67) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:39.996989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:39.998422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e435d-7ca6-4a41-a29b-42509baffa6b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:40.005537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 418/832] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:39 2022] GET /identity/v3/role_assignments?user.id=aebe4b5d4c0c40218341971859875d67&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:40.457664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e68f5a-3576-46c4-bed1-864010c66404 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:40.458048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e68f5a-3576-46c4-bed1-864010c66404 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:40.458259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e68f5a-3576-46c4-bed1-864010c66404 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:40.459910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 415/833] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:40.465336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:40.465624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:40.465903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:40.483680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:40.484891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:40.559827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 419/834] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:40.576667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e68f5a-3576-46c4-bed1-864010c66404 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:40.610200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:40.703541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e68f5a-3576-46c4-bed1-864010c66404 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:40.741572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676f21c-dad0-4bd0-aff1-c6398bf678aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:40.742290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676f21c-dad0-4bd0-aff1-c6398bf678aa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:40.742571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676f21c-dad0-4bd0-aff1-c6398bf678aa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:40.742841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676f21c-dad0-4bd0-aff1-c6398bf678aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:40.753953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676f21c-dad0-4bd0-aff1-c6398bf678aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-9676f21c-dad0-4bd0-aff1-c6398bf678aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:40.761771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:40.762979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:23:40.763823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:40.767438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 416/835] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:40.770230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:40.837096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a6a20-6752-4c52-8913-cc7d87101fc1 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:40.837386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a6a20-6752-4c52-8913-cc7d87101fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:40.837664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a6a20-6752-4c52-8913-cc7d87101fc1 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:40.840541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 417/836] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:40.844705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:40.844997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:40.845277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:40.864814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:40.866007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:40.876716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:40.880784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3680c-08c1-429b-9a9c-8b5d9cb86806 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:40.918484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:40.919168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:40.919456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:40.919747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:40.920511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:40.920819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:40.922556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:40.935749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 420/837] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:40.938294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:40.955739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 418/838] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:40.972957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:40.999763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.092928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fe39c-bda2-47f8-8939-587f3382739c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.136117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.137033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.137379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.137975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.138702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.140202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:41.152851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:41.153897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:41.154708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:41.159008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 419/839] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:41.160243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.184244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91c440-6d1c-42e8-aa44-2a939e758f83 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.224921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.226422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.227249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.227747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.243875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.246143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.254370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.272070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a850-a508-44c2-9b09-90dec6d1c90a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:41.273229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:41.274121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:41.275005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:41.275005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:41.275005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:41.275005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:41.278070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 421/840] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:41.284977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.305427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.321420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.322536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.322828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.323110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.323927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:41.324251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.325625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.331760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 420/841] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:41.338460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.414482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad62bf5-8d3c-4ddd-b4a8-ac38c16acdd8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.455298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.456365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.456954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.457419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.458423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:41.458888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.460446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d1774-73ef-4f96-9ee1-b68c8b83be03 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.460593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181f96-7607-4887-808e-16ff1e4b721a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.477522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 422/842] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:41.478909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7fb21-2c7f-4e07-ac54-cc9edaf2d988 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.479198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7fb21-2c7f-4e07-ac54-cc9edaf2d988 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.479472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7fb21-2c7f-4e07-ac54-cc9edaf2d988 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.480867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 423/843] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:41.482856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7fb21-2c7f-4e07-ac54-cc9edaf2d988 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.504058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.504791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.505016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.505354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.506194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:41.506499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.508022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e8d6-3eb5-4dce-8e2b-cb8156a3c30d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.524185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 421/844] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:41.525529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.525821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.526100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.556299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:41.558897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:41.573893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.577563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.613387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7fb21-2c7f-4e07-ac54-cc9edaf2d988 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.656022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.656782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.657158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.657507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.675748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.675748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.676045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 422/845] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:41.692359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:41.693473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 09:23:41.694426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:41.694942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.695416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 424/846] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:41.703667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.803292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060bfdd-4b7e-4ddd-9520-4aaf7975cd79 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.808116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e0f61-1561-4cc0-84bf-ca555febd2ff None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.841508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.842642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.843116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.843580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.844455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:41.845140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:41.845424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:41.845770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:41.846631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:41.846943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:41.848435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:41.850244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.860183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:41.869013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:41.869952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:23:41.870773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:41.877881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 425/848] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:41.877881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.879777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 423/848] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:41.880992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:41.885188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:41.981680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82329c4-0cb8-4f3f-ab72-f181a63908ec None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:41.995981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e097c-8f1a-4a4d-9107-71f66f9fb561 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.017218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4b2e-a25d-4053-b88f-c61336e54fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.018432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4b2e-a25d-4053-b88f-c61336e54fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.018719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4b2e-a25d-4053-b88f-c61336e54fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.018999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4b2e-a25d-4053-b88f-c61336e54fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.034501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.035524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.036058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.036529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.037499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:42.038041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.039778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.049994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 424/849] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:42.055170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.097252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.110444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4b2e-a25d-4053-b88f-c61336e54fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.112460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4b2e-a25d-4053-b88f-c61336e54fc3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.131672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.172121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e0662-6bb3-4348-840e-f96db0f92a78 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.211065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.211901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.212162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.212438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.224266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.226078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.247749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 426/850] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:23:42.247749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971495-7c00-47ce-b3f0-490a9eb7333e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:42.248040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:42.249042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:42.250144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:42.250144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:42.250144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:42.250144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:42.250412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971495-7c00-47ce-b3f0-490a9eb7333e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.250412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971495-7c00-47ce-b3f0-490a9eb7333e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.250566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 425/851] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:42.250635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 427/852] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:42.255879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.256017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.256017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.256017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.273317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:42.274511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:42.351978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 428/853] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:42.351978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.372775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef6fa-a996-4692-aed0-a02c227b2caf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.382718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.395260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.416688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.417495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.417784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.418061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.429464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.430944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:42.449632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:42.450621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:42.451500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:42.451500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:42.451500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:42.451500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:42.455883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 426/854] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:42.456936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.469429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d9bd-0661-47f4-a06e-1b641026eb2a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.505389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.506054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.506334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.506604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.507317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:42.507618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.509010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.521288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 429/855] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:42.522139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.583337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6e2d-6ede-4fae-986b-8331600b080d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.608329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.621200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.622043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.622344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.622591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.623315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.624626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.629363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c3dd-ba80-41f7-8f02-596294ed1272 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:42.638789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:42.639777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:42.640610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 427/856] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:42.641985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.674458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.675166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.675452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.675746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.676531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:42.676927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.678545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.682035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.694157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 430/857] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:42.695030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.775212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193890-20b7-4c10-91d8-102d8ccb9991 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.814245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a998fd-1653-4e26-9f81-0a9f1c8aa455 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.816475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.817297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.817581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.817859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.828194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.830187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:42.845603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:42.846571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:42.847482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 428/858] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:42.848777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.863299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.864057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.864404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.864774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:42.865458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:42.865762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:42.867365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:42.877178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 431/859] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:42.877178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:42.890108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.952230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:42.960602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f788c-62be-4af9-9093-7f5666eb2b09 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.989129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9a0d-4808-41c8-8aa3-2a705972de55 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:42.994462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:42.995271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:42.995557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:42.995868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.004386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.005825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:43.021172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:43.022315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:43.023532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:43.027251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 429/860] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:43.028171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.033566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.034452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.034881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.035304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.036363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:43.036819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.038399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.057293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 432/861] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 20 09:23:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:43.058152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.132526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:43.147292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b939-db3b-4327-8851-8e18bf1ed8b7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.174260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106937e-d06d-4719-b6f5-9b88f957a52c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.184359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.185039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.185323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.185603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.186315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:43.186627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.188014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.193451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 430/862] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:43.194264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.225015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.225708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.225995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.226164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:43.226270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.227063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:43.227444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.229050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.246856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 433/863] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:43.247878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.345169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea498f-d642-43c7-9b38-3cb699248f64 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.367831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3cea-b61a-449e-b4fb-b8127d93fea4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.386435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049809b-aa29-4b59-8c90-e66c928302b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.387111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049809b-aa29-4b59-8c90-e66c928302b1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.387954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049809b-aa29-4b59-8c90-e66c928302b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.388283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049809b-aa29-4b59-8c90-e66c928302b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.395292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:43.407840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.409112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.409402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.409684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.410521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=92eaddc698594f328d27c7e3c7bf6a02) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:43.410834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.412297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.419150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 434/864] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:43 2022] GET /identity/v3/role_assignments?user.id=92eaddc698594f328d27c7e3c7bf6a02&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:43.472532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049809b-aa29-4b59-8c90-e66c928302b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.474331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049809b-aa29-4b59-8c90-e66c928302b1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.496802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:43.590065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 431/865] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:23:43.598660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.632280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c6d9-01d9-458e-9eb0-9a501deee743 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.632579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c6d9-01d9-458e-9eb0-9a501deee743 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.632842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c6d9-01d9-458e-9eb0-9a501deee743 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.634453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 432/866] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:43.639873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.640035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.640304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.658888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:43.660150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:43.713001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601820d8-b483-4799-bb11-b5071306f780 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.749265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 433/867] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:43.763541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.764385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.764673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.764951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.776217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.778595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.784634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:43.809198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:43.810144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:43.810999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:43.810999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:43.810999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:43.810999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:43.811592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 435/868] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:43.817261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:43.837655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:43.865091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:43.903928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ddde5-ddda-4e6d-9515-f4d25657a7e0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.937494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5c344-890e-4b8d-a38a-1798e660fe0c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:43.948756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.949762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.950196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.950757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.951665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.953415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:43.978257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 434/869] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:23:43 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:23:43.984599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:43.985287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:43.985854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:43.986169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:43.986951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:43.987255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:43.988693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:44.003412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 436/870] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:44.009383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:44.123626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0db13-6360-4552-b580-fa9fbdfa5470 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:44.134145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:44.164577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:44.164987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:44.165166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:44.165452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:44.173504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:44.175475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:44.189928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:44.190801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:44.191675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 435/871] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:44.198584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:44.308107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:44.315301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8763-a16b-4d8b-9665-216ce9cdfa94 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:44.351665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:44.352369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:44.352653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:44.352931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:44.353723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:44.354032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:44.355472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378be59-ae3f-4ac7-a1e6-419d851123fd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:44.368390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 437/872] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:44.374542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:44.486548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a712-a77a-4071-8a4c-8aa601e25cf4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:44.523953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:44.525012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:44.525504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:44.525985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:44.527033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=81e2cdcf476e40039b7839b529f0ebeb) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:44.527585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:44.529255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5285219-46ba-4b3b-8834-8f7b592a040a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:44.536770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 436/873] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:44 2022] GET /identity/v3/role_assignments?user.id=81e2cdcf476e40039b7839b529f0ebeb&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:45.331337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b21ef-dcf9-4508-b648-5b240eb6a248 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:45.331891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b21ef-dcf9-4508-b648-5b240eb6a248 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:45.332076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b21ef-dcf9-4508-b648-5b240eb6a248 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:45.333523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 438/874] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:45.339010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a149cc-bcb8-4b50-bbb5-819ba29f3773 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:45.339445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a149cc-bcb8-4b50-bbb5-819ba29f3773 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:45.339623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a149cc-bcb8-4b50-bbb5-819ba29f3773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:45.357258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-40a149cc-bcb8-4b50-bbb5-819ba29f3773 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:45.358442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-40a149cc-bcb8-4b50-bbb5-819ba29f3773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:45.386167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:45.432288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 437/875] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:45.455435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b21ef-dcf9-4508-b648-5b240eb6a248 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:45.564056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b21ef-dcf9-4508-b648-5b240eb6a248 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:45.567705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20136-1c6e-4b59-9b1b-de5ab9e5e332 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:45.568030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20136-1c6e-4b59-9b1b-de5ab9e5e332 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:45.568312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20136-1c6e-4b59-9b1b-de5ab9e5e332 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:45.569812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 438/876] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:45.575255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:45.575549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:45.575864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:45.597964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:45.599240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:45.603939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:45.604895 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:45.605385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:45.605867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:45.606802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:45.608413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:45.625381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 439/877] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:23:45 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:45.692317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 439/878] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:45.715451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:45.737565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:45.850690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6322e2-74d1-4241-8058-7a4071be28e4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:45.891662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:45.892575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:45.892865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:45.893145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:45.893829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:45.895218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:45.908886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:45.909905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:45.910878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 440/879] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:45.918468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.014081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:46.028004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b84a6-c338-480a-926b-a006599f63f8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:46.063783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:46.065343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.065839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.066329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.067229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:46.067761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:46.069332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194a172-b6b1-456a-8bb7-45aaf6bf276c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:46.078930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 440/880] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:46.081084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.168954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:46.191835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08fb10-ea7f-4c76-bb11-dc417eaf2d40 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:46.229892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:46.230975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.231464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.231977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.232903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:46.233424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:46.234995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba896-da4f-481b-922c-9ce082c1f755 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:46.247909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 441/881] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:46.282391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bd9f1-0551-42e4-b389-aba258303125 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.282721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bd9f1-0551-42e4-b389-aba258303125 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.282999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bd9f1-0551-42e4-b389-aba258303125 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.284745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 441/882] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:46.290374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.290660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.290946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.310565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:46.311831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:46.400418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 442/883] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:46.422905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bd9f1-0551-42e4-b389-aba258303125 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.543583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bd9f1-0551-42e4-b389-aba258303125 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:46.579620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:46.581280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.581724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.582144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.582946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:46.584477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-c30462cc-e728-457a-887d-0ac2e53ba08e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:46.598634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:46.599643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:46.600525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 442/884] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:46.604498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.683614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:46.710599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2597d-18ce-4273-a746-5435697f0f25 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:46.729572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d75350-9736-45fd-b517-a3a958c72096 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.730184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d75350-9736-45fd-b517-a3a958c72096 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.730664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d75350-9736-45fd-b517-a3a958c72096 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.732599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 443/885] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:46.737672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.737819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.738095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.752152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:46.752855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.753138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.753412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.754121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:46.754429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:46.755854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:46.756607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:46.757813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:46.761357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 443/886] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:46.768899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.775844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:46.846037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 444/887] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:46.869166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.880012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ab33-d7d0-4dd6-8bf4-5aef6c429f3c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:46.928444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:46.929116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:46.929397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:46.929673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:46.930924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:46.931238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:46.932981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:46.941131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 444/888] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:46.946254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:46.951246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:46.987555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de138-7c1a-45a5-92ea-5df77ed71383 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.027911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.029053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.029446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.029829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.041547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:47.050205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:47.051123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:47.051981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 445/889] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 20 09:23:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:47.058144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.071355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:47.080685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90f8c9-44f9-4e04-8988-6b139c283fa7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.119455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.119880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.120115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.120393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.121191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] RBAC: Adding query filter params (interface=public, service_id=dc9fac8c95ec4369ad44d67248e63ae6, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:47.121506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:47.122900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:47.128595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 445/890] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:23:46 2022] GET /identity/v3/endpoints?service_id=dc9fac8c95ec4369ad44d67248e63ae6&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:47.133847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.194144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3e1f-4d02-4add-becf-ff24a0973152 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.205170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:47.234189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.235152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.235575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.236582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.237578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:47.238036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:47.239627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:47.244527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78848c6-18ce-4b42-bf64-6d03877c5778 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.249305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 446/891] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:47.256357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.290034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.291090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.291381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.291659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.292654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:47.294260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:47.307776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 446/892] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:23:47.348233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:47.383423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2547d-bcf0-4673-baae-8a5284825027 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.422868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.423759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.424283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.424283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.437794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:47.440642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:47.461946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:47.462874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:47.463801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:47.463801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:47.463801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:47.463801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:47.463801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 447/893] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:47.472011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.591864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d7af-bff3-43b4-9d9a-522f71de05d7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.639744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:47.647762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.647762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.647762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.647762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.648141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:47.648141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:47.651745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee81fb-3fbf-42d4-b3af-dda786efe136 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:47.662305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 447/894] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:47.667146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.776196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bf3c-0c52-44f9-828f-10bba8ff28c6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:47.805387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:47.806961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1b8c-a6d6-48cf-ac1b-99fae6576d2c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.807387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1b8c-a6d6-48cf-ac1b-99fae6576d2c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.807675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1b8c-a6d6-48cf-ac1b-99fae6576d2c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.810283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 448/895] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:47.817035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.817543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.818072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.831189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:47.832069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:47.832982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:47.833267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:47.843376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:47.843896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:47.844961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:47.845622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:47.860700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:47.862311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 448/896] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:47.868452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.947817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 449/897] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:47.971793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:47.987828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc384e-dc35-4c20-9b55-8a2a1a2b6882 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.025704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.026554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.026787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.027062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.027960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:48.028271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.029830 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.054937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 449/898] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:48.056025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.079464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebeb1a-0be4-44a0-9f0d-3e9788e51629 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.100072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.107644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.121799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.122638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.122920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.123193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.123887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.125526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:48.140199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:48.141552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:48.142423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 450/899] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 20 09:23:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:48.150478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.189808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f051-4ffd-437d-816d-72ddaedd51e7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.233987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e77fc9-0844-4159-9ace-905b23f6fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.234792 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e77fc9-0844-4159-9ace-905b23f6fafa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.235392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e77fc9-0844-4159-9ace-905b23f6fafa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.235677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e77fc9-0844-4159-9ace-905b23f6fafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.289507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b641-5e22-4722-a6e8-c54743c468cc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.314337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e77fc9-0844-4159-9ace-905b23f6fafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.315963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e77fc9-0844-4159-9ace-905b23f6fafa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.335627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.336333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.336616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.336891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.338130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:48.338450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.340136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.348408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 451/900] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:48.353774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.363823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.424932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.437572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 450/901] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:23:48.438952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ce2e-1378-4248-9c27-62ef7ef959b9 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.439308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ce2e-1378-4248-9c27-62ef7ef959b9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.439626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ce2e-1378-4248-9c27-62ef7ef959b9 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.443769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 451/902] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:48.444343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953ce2e-1378-4248-9c27-62ef7ef959b9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.498761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc73ce-95ff-4ab9-a030-c90c60aebbe2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.537338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.538123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.538412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.538802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.539761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:48.539995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.541366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e69420-fec8-4a92-8163-fcaca90c83a6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.556465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 452/903] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:48.556465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.556465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.556465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.567877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953ce2e-1378-4248-9c27-62ef7ef959b9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.570100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:48.571344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:48.605371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.606165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.606435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.606704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.614303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.618459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.620129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:48.640491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:48.641425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:48.642817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:48.642817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:48.642817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:48.642817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:48.642817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 452/904] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:48.643111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.649040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 453/905] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:48.649867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.696879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.756495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e85d88-eebd-4bae-9213-781196808ef8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.757565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961509f-7a9f-44b4-ae2e-b01d2d149f34 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.794251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.794442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.794847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.794966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.795139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.795243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.795420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.795518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.796157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:48.796253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] RBAC: Adding query filter params (interface=public, service_id=c3e502a03aa7452e803685ed67c855a2, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:48.796465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.796586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.797864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.797969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.806587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 453/906] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/endpoints?service_id=c3e502a03aa7452e803685ed67c855a2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:48.807398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.819073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 454/907] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:48.819073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.876622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.928318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9604e6-9bf9-4cf8-95ee-3bb0b8b31fc0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.933039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707a68-ffb3-4e35-9b92-0e8985a153e5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:48.935774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:48.968480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.969148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.969437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.969715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.970469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.971859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.971963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:48.972578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:48.972862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:48.973136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:48.973825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:48.975163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:48.984124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 455/908] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:23:48.984941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:48.998201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 454/909] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:23:48 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:49.127698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09fe6-ba97-4917-aade-3bb87077cd99 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:49.176037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:49.176864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.177146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.177421 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.186858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:49.188749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:49.204984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:49.206043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:49.206975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 456/910] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:49.213239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:49.323509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d17b2-2828-4826-9dee-21d1cda8ae12 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:49.339002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:49.360768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:49.362369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.362656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.362934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.363755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:49.364074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:49.365516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09775-e1dd-410b-8aab-480c9c7b64df None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:49.379133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 455/911] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:49.384595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:49.410546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:49.493425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76a41-06b6-49d9-b693-61ebf25395f8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:49.530722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c8f9-fe5c-4951-90d5-49447a996e61 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.531266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c8f9-fe5c-4951-90d5-49447a996e61 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.531266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c8f9-fe5c-4951-90d5-49447a996e61 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.532819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 456/912] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:49.537220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:49.538294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.538587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.538863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.539096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.539602 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.540114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.541174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] RBAC: Adding query filter params (role.id=23a9d568e28042159c03d2b4e4c6a05c, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=81e2cdcf476e40039b7839b529f0ebeb) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:49.541720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:49.543388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:49.550259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 457/913] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:49 2022] GET /identity/v3/role_assignments?user.id=81e2cdcf476e40039b7839b529f0ebeb&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=23a9d568e28042159c03d2b4e4c6a05c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:49.556657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:49.558113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:49.637898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 457/914] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:49.662220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:49.760239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:49.777042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7dde-799b-473c-b317-0768e96e6492 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:49.814432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:49.815247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.815526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.815833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.816496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:49.817870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:49.830992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:49.832220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:49.833073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 458/915] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:49.840828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:49.958719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb299e-55b0-448d-8df2-79d5249e7bf0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:49.961120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:49.995050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:49.995741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:49.996035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:49.996451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:49.997161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:49.997475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:49.998836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:50.004107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 458/916] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:50.009404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:50.120060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009f69-5343-4a0a-8e4a-adc8d2e49f7b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:50.155964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:50.157004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:50.157491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:50.158612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:50.159640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:50.160198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:50.161778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ad507-109d-4062-a385-9479e2128054 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:50.167564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 459/917] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 20 09:23:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:50.177014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:50.293514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1bf57-0416-4f45-9665-0d9fdd34529b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:50.329398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e71e3-5e53-42f0-b542-1c3bd72be3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:50.330602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e71e3-5e53-42f0-b542-1c3bd72be3d4 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:50.330884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e71e3-5e53-42f0-b542-1c3bd72be3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:50.331159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e71e3-5e53-42f0-b542-1c3bd72be3d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:50.331941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e71e3-5e53-42f0-b542-1c3bd72be3d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:50.333305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e71e3-5e53-42f0-b542-1c3bd72be3d4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:50.354251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 459/918] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:23:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:51.164241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bbac3-a343-43c8-9fd2-0f4569a3ba1c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.164771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bbac3-a343-43c8-9fd2-0f4569a3ba1c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.164963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bbac3-a343-43c8-9fd2-0f4569a3ba1c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.166851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 460/919] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:51.172452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.173307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.173822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.191972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:51.193533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:51.214253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:51.218870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3470fd2-4a03-46eb-9d24-9797d54c82e7 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.219420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3470fd2-4a03-46eb-9d24-9797d54c82e7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.219956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3470fd2-4a03-46eb-9d24-9797d54c82e7 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.222099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 461/920] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:51.228777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.229392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.229869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.249898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:51.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:51.262318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:51.291851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 460/921] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:51.309948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.324675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 462/922] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:51.347558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.417233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f99efa-cc86-4171-9075-ccd0ab0d8e74 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:51.449714 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34c714-15fe-4a46-8225-8e3329d3d2aa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:51.455040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:51.455902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.456190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.456471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.457133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:51.458522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:51.472828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:51.473790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 09:23:51.474592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:51.479046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 461/923] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:51.480474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.492000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:51.492813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.493089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.493356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.494008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:51.495557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:51.508671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:51.509771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:51.510593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:51.518569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 463/924] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:51.519808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.532178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:51.535464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:51.606755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87068d-25b0-4b09-94ec-5a797c6521f6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:51.647947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:51.648876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.649305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.649753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.650596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:51.651088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:51.652653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:51.658928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 462/925] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:51.665344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.678662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c23c4-a8d3-49ab-992a-7186bfc16e7d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:51.719404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:51.720205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.721440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.721719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.722730 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:51.723042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:51.724590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea7421-2ec7-49a1-874d-529f43ee4bcf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:51.729848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 464/926] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:51.732865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ad0bb-cb7a-48e4-b54f-11598e4bf766 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.733816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ad0bb-cb7a-48e4-b54f-11598e4bf766 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.734271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ad0bb-cb7a-48e4-b54f-11598e4bf766 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.735760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 465/927] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:51.737293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ad0bb-cb7a-48e4-b54f-11598e4bf766 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.766316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:51.789686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8b15b-cde8-4872-bf5b-6c8c4e0ce268 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:51.820147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:51.834581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:51.835262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.835812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.836093 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.836814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:51.837123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:51.838486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c76beb-3adf-4637-a2c6-32302194506a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:51.843542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 463/928] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:51.844936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.845398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.845835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.860701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ad0bb-cb7a-48e4-b54f-11598e4bf766 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:51.862409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:51.863588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:51.908671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:51.909670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:51.910142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:51.910617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:51.911515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:51.911855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:51.913241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:51.918983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 466/929] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:51.919911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:51.948676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 464/930] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:51.952892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.034916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.040166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910f89-86fc-4b04-b148-d29b81956870 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.067219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f8e6c-2fd9-4849-8dde-2e00eed10ae7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.080747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.081692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.082431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.082732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.083788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.085792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.091979 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.106430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.107104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.107428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.107710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.108699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] RBAC: Adding query filter params (interface=public, service_id=8f17a69b50cb41b9a1beffb9de7f0c03, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:52.108993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.110357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.120168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 467/931] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:23:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:52.120168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.120464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 465/932] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:23:51 2022] GET /identity/v3/endpoints?service_id=8f17a69b50cb41b9a1beffb9de7f0c03&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:52.122468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.248118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cbb7a-56f3-45ea-aeac-2fd2c759dd10 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.271913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9e0f-9604-431a-a4c9-32756ef79a8c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.296345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.297408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.297696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.298360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.299424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.300820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.302913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.308153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 466/933] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:23:52.322536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052cb89-cd42-47b7-97dc-82e38656333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.323399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052cb89-cd42-47b7-97dc-82e38656333c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.323691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052cb89-cd42-47b7-97dc-82e38656333c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.324001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052cb89-cd42-47b7-97dc-82e38656333c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.338084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052cb89-cd42-47b7-97dc-82e38656333c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6052cb89-cd42-47b7-97dc-82e38656333c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:52.346775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:52.347852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.349363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 468/934] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:52.354797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.473995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d00c86-6b52-4d20-a69e-29e4b1bf6782 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.492002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107edf-e2f2-4bfb-9f86-89cd2e6ef22d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.492342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107edf-e2f2-4bfb-9f86-89cd2e6ef22d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.492567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9107edf-e2f2-4bfb-9f86-89cd2e6ef22d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.493956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 469/935] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:52.500552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.500811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.501343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.512856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.513536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.513820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.514098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.514839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:52.515147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.516546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.524541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:52.525343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:52.528741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 467/936] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:52.534770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.580551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.607848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 470/937] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:52.614352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.635266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.657429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697229-8561-4d64-859f-225f98b3b733 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.696584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.697865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.698384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.698917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.711366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.713153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:52.733066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:52.734042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:52.734915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:52.734915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:52.734915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:52.734915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:52.737900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 468/938] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:52.743385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.758852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49755b8-aab4-4ff7-ac75-c17cb74a52af None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.797854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.798980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.799468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.800025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.800973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.802647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.804345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING keystone.server.flask.common [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 09:23:52.824453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 09:23:52.824453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 09:23:52.824453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [parameters: {'id': 'a11c8c1f48194df0aac366eedec743da', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 09:23:52.824453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a11c8c1f48194df0aac366eedec743da.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a11c8c1f48194df0aac366eedec743da. Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:23:52.836048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 09:23:52.836874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Jul 20 09:23:52.837812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 09:23:52.838726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 09:23:52.848326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:23:52.850249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'id': 'a11c8c1f48194df0aac366eedec743da', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:52.852370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:52.854230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a11c8c1f48194df0aac366eedec743da. Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 471/939] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Jul 20 09:23:52 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:52.856378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.865746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff5aa-1c98-4e66-b53c-f5c2fcc369db None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:52.880981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.882688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:52.906521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:52.907351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:52.908355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:52.908735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:52.909639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:52.910077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:52.911550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:52.925979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 469/940] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:52.931284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:52.979909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ab72-8ae8-48ed-b00e-884f02c61109 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.025470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.026203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.026502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.027568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.036700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.038626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:53.057229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:53.058150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:53.059002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:53.066416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981988f-bbc3-4d40-873b-2c021f50c57e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.067129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 472/941] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:53.068252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:53.109183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.110010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.110294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.110573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.120897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.123154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:53.145001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:53.145997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:53.146895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:53.151136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 470/942] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:23:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:53.152964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:53.179004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:53.188774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735545-71a3-48f6-9aa0-a8fc4b6deb59 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.196794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:53.229263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.230439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.230944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.231437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.232532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:53.233034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.234750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.264143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 473/943] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:53.278116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbd4d-c7ad-45fa-969c-28fabcc71315 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.317633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.318328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.318617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.318928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.319782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:53.320106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.321571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.342265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 471/944] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 20 09:23:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:53.348891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:53.469882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52ee0-c36f-469d-8c84-e73ff4f570c4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.508389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.509305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.509598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.509878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.522400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.523905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:53.543179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:53.544122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:53.545008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:53.545008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:53.545008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:53.545008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:53.545008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 474/945] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:53.550649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:53.645682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:53.654575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e394aa9-d4ab-4763-92db-4506d5195ac4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.690338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.691017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.691303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.691581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.692341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:53.692652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.694016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.705922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 472/946] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:53.711619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:53.725050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:53.822049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd54c3-8316-4813-a5c5-5f8ed2db0a28 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:53.857846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:53.858655 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:53.858939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:53.859218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:53.866966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:53.868470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:53.883316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:53.885548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:53.887977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 475/947] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:53.893674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:53.999750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f1e2-aa39-4c55-8f4b-6f6c1f173508 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.036345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:54.037014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.037302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.037578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.038443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:54.038754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:54.040262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946bb61-05ba-4b21-9681-d97e64e68b08 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:54.053771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 473/948] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:54.059360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:54.129471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.166110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5904-6185-4969-a2f4-6d9c5141ece6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.201767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a07fbd-2789-4540-9953-0535b27ee1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:54.202667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07fbd-2789-4540-9953-0535b27ee1a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.202958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07fbd-2789-4540-9953-0535b27ee1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.203230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07fbd-2789-4540-9953-0535b27ee1a8 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/81e2cdcf476e40039b7839b529f0ebeb/roles/23a9d568e28042159c03d2b4e4c6a05c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.205652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a07fbd-2789-4540-9953-0535b27ee1a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=81e2cdcf476e40039b7839b529f0ebeb, role_id=23a9d568e28042159c03d2b4e4c6a05c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:54.207095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a07fbd-2789-4540-9953-0535b27ee1a8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:54.223237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 476/949] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:23:54 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/81e2cdcf476e40039b7839b529f0ebeb/roles/23a9d568e28042159c03d2b4e4c6a05c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:23:54.339763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc1fc1-4276-47f5-8b21-641b334fabd4 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.339763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc1fc1-4276-47f5-8b21-641b334fabd4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.339763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc1fc1-4276-47f5-8b21-641b334fabd4 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.341110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 474/950] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:54.347205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd928d-0119-4951-9ee5-226117bd7f75 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.347595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd928d-0119-4951-9ee5-226117bd7f75 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.347981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd928d-0119-4951-9ee5-226117bd7f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.366073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bcbd928d-0119-4951-9ee5-226117bd7f75 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:54.367617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bcbd928d-0119-4951-9ee5-226117bd7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:54.451031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 477/951] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:54.470715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc1fc1-4276-47f5-8b21-641b334fabd4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:54.481405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3369-1593-498c-a3c1-a1bc25032c9a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.482065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3369-1593-498c-a3c1-a1bc25032c9a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.482536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3369-1593-498c-a3c1-a1bc25032c9a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.484393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 478/952] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:54.487283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.490559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.491018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.491468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.509316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:54.510754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:54.578130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.603744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 479/953] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:54.613430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc1fc1-4276-47f5-8b21-641b334fabd4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.622964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:54.652870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:54.653823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.653947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.654198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.654851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:54.656380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:54.669668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:54.670758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:23:54.671844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:54.675997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 475/954] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:54.677454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:54.737454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613736-4f6c-4afb-87fd-d0a27b934733 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.762926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.774576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:54.775691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.776232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.776719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.777614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:54.779287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:54.789187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593135c6-20c3-4aae-8933-2587cc36e7f5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:54.792829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:54.793874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:54.794750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:54.802916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 480/955] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:54.804119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:54.837714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:54.838391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.838674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.838950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.839737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:54.840059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:54.841492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:54.851131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 476/956] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:54.852444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:54.861590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.918177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b122c-95d7-445c-8aad-c7f48410aa0f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.955380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:54.956490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:54.956984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:54.957465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:54.958386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:54.958929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:54.960544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:54.962014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa6118-0c4d-40ed-b35d-7ba70c2c4107 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:54.971469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 481/957] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:54.972663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:55.000334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:55.000712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.001001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.001810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.002590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:55.002836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:55.004278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:55.015902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 477/958] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:55.092032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a949-cb99-425a-a7bd-af1a993293c3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:55.109197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:55.133596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:55.134787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.135288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.135799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.136742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:55.137256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:55.139149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922481dc-0125-4aee-bc5e-af516460844a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:55.145690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 482/959] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:55.151802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:55.157105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:55.262335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e04a95-2c76-4717-b1a3-10c8529c0251 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:55.304803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed15b63-6aaf-45bf-bbdd-dbbb196450a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:55.305534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15b63-6aaf-45bf-bbdd-dbbb196450a7 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.305824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15b63-6aaf-45bf-bbdd-dbbb196450a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.306100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15b63-6aaf-45bf-bbdd-dbbb196450a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.306913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15b63-6aaf-45bf-bbdd-dbbb196450a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:55.308315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15b63-6aaf-45bf-bbdd-dbbb196450a7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:55.329615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 478/960] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:23:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:55.503021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6e64-2078-4e0f-ac3e-1feb8c184307 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.503559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6e64-2078-4e0f-ac3e-1feb8c184307 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.503636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6e64-2078-4e0f-ac3e-1feb8c184307 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.505261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 483/961] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:55.510554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.510981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.511176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.529227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:55.530335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:55.588209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:55.607635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 479/962] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:55.635049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6e64-2078-4e0f-ac3e-1feb8c184307 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:55.743151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6e64-2078-4e0f-ac3e-1feb8c184307 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:55.777696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:55.778373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.778652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.778923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.780090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:55.781459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:55.795300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 09:23:55.795300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 09:23:55.795300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [parameters: {'user_id': 'd8418c05d4ee415daa7b1cd5ffaed676', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 09:23:55.795300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 20 09:23:55.803447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:23:55.804348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 09:23:55.805710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 09:23:55.806860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 09:23:55.807773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 09:23:55.808630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd8418c05d4ee415daa7b1cd5ffaed676', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:55.809453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 09:23:55.817735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:55.821155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 484/963] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 20 09:23:55 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:55.822051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:55.928912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43aec-76a8-48d3-b358-5c5d8dd42bd3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:55.965161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:55.966321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:55.966810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:55.967394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:55.975693 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:55.977385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-989b1582-82cf-45b2-a705-5fdabae7dd37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:55.993050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:55.994106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 09:23:55.995038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:55.997706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 480/964] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:23:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:56.005296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:56.050194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:56.115487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724eb7d-23f3-4d23-bfd3-9e1a695ec32e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:56.151379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:56.152088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:56.152374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:56.152652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:56.153463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:56.153771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:56.155421 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46b9fd-7563-4b17-8d79-fdefaa1c45e8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:56.194567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 485/965] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 20 09:23:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:56.369947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe857c8-6a05-4d02-8deb-a91a7b2e88e9 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:56.370155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe857c8-6a05-4d02-8deb-a91a7b2e88e9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:56.370437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe857c8-6a05-4d02-8deb-a91a7b2e88e9 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:56.372088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 481/966] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:56.378157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:56.378452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:56.378733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:56.397131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:56.398634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:56.472422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 486/967] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:56.498938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe857c8-6a05-4d02-8deb-a91a7b2e88e9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:56.550216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:56.605541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe857c8-6a05-4d02-8deb-a91a7b2e88e9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:56.642163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:56.642912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:56.643291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:56.643856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:56.654844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:23:56.663709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:56.664648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:23:56.665858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:56.666927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 482/968] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 20 09:23:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:56.671107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:56.700786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:56.775119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82077e9f-e16c-4190-b9ed-b407db72b7f8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:56.815402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:56.816113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:56.816396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:56.816670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:56.817423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:56.817725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:56.819094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:56.835009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 487/969] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:23:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:56.836298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:56.948273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4832-a83f-447c-b03a-fb7f4bf27626 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:56.956208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:56.984718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:56.985511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:56.986317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:56.986595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:56.996997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:56.998446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:57.016998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:57.017948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:57.018834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:57.018834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:57.018834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:57.018834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:57.019852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 483/970] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:57.023991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.119106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.130056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349466d-be1f-49c9-afdc-08f093e5108d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.164250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.164923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.165209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.165485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.166213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:57.166520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.167929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d2887-8d80-4178-9e6f-7c1f68942f70 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.180261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 488/971] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:57.185768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.202719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffb8f6-8f6c-49a7-980f-155869a6662f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.202992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffb8f6-8f6c-49a7-980f-155869a6662f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.203199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffb8f6-8f6c-49a7-980f-155869a6662f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.204861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 489/972] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:23:57.209604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.209888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.210164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.227504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:57.228730 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:57.299953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 490/973] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:57.305567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbf700-620c-493a-908d-c7193095ccc6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.322575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.351555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.353831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.354129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.354653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.363974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.365429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:23:57.381570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:57.382542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:57.383510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 484/974] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:57.388800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.408351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.415965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.438292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4aa4-9e05-41da-b2f0-9b70c338ad8f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.473520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86228755-d3ab-4a33-8f80-6750480705d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.474187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86228755-d3ab-4a33-8f80-6750480705d6 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.474472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86228755-d3ab-4a33-8f80-6750480705d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.474741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86228755-d3ab-4a33-8f80-6750480705d6 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.475458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86228755-d3ab-4a33-8f80-6750480705d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.476844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86228755-d3ab-4a33-8f80-6750480705d6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.490763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 491/975] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:23:57 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:23:57.492056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c3e4-a78c-4fa8-b7b9-f39852f93e74 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.492339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c3e4-a78c-4fa8-b7b9-f39852f93e74 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.492620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c3e4-a78c-4fa8-b7b9-f39852f93e74 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.493860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 492/976] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:57.499616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214ed8-6e54-4881-9b53-1ec56e6c763c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.499936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.500222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.500502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.524204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:57.525783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:57.547113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.547869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.548794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.549133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.550018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:57.550358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.551832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.575776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 485/977] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:57.577698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.612018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 493/978] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:23:57.637052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.679309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.711950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3b65a-0225-42dc-aa6d-bba86243a867 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.716632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.752076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.752652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.752939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.753188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a260ad9-9903-4d7e-874e-eebb7629ddaf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.753295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.792855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.793699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.793985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.794262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.794919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.796335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:57.809109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:57.810678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:57.811554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 494/979] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:57.816640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.840111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.841562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.917496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.930176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8897e0-56c5-4c48-be35-eaa20ab6694a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:57.963749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 486/980] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:23:57.969168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:57.971568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:57.972284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:57.972572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:57.972851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:57.973563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:57.973870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:57.975247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:57.976584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:57.986996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 495/981] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:57.987960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.086375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2400bc-c79c-418d-9fed-20980c16d9f1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.096247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752502-ce70-4239-86db-0a561ba6545a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.122399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.123200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.123485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.123784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.132845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.133527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.133816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.134098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.134808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:58.135120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.135308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.136536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.136743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.142816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 496/982] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:58.148509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:23:58.155789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:58.156668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:58.157623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:23:58.157623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:23:58.157623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:23:58.157623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:58.160029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 487/983] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:58.162563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.191211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:58.221831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:58.264127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04559c7a-d62a-427b-8a38-210502c64d84 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.293691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099ee0b-ad52-4fff-bee3-9bd59829c473 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.299599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.300299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.300586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.300863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.301667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] RBAC: Adding query filter params (interface=admin, service_id=8f17a69b50cb41b9a1beffb9de7f0c03, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:58.301989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.303365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.309135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 497/984] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Jul 20 09:23:58 2022] GET /identity/v3/endpoints?service_id=8f17a69b50cb41b9a1beffb9de7f0c03&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:58.315018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.339205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.339839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.340126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.340404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.341120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:58.341430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.342791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.354935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 488/985] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:58.360442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.421848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16b0a-39a2-46ed-bd90-657c5402bf49 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.448341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:58.455556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:58.459348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.460512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.460810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.461100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.461788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.463173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.470293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 498/986] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:23:58 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:23:58.472831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec868a-66b2-4701-8593-524942a8fe7e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.515377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.516230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.516514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.516847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.524839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.526325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:23:58.542083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:58.543036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:23:58.543925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 489/987] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:23:58.549883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.667405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3106-f7b6-4547-a927-9e813531293c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.703075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.703777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.704067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.704346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.705140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:58.705455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.706894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2d098-72b2-420c-b8cd-fa67f1ab2ce4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.719446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 499/988] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:23:58.726915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:58.839420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd64c6-f221-4794-bd7e-84ead5e1d7db None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:58.875531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:58.876255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:58.876543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:58.876827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:58.877672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] RBAC: Adding query filter params (role.id=23a9d568e28042159c03d2b4e4c6a05c, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=81e2cdcf476e40039b7839b529f0ebeb) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:23:58.877987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:58.879433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385968e-6522-4b4b-80ae-edcc396390bd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:58.894059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 490/989] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:23:58 2022] GET /identity/v3/role_assignments?user.id=81e2cdcf476e40039b7839b529f0ebeb&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=23a9d568e28042159c03d2b4e4c6a05c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:23:59.550096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14a9c-70d2-4881-a7fa-90d3901c18be None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:59.550408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14a9c-70d2-4881-a7fa-90d3901c18be None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:59.550675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14a9c-70d2-4881-a7fa-90d3901c18be None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:59.552211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 500/990] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:23:59.557398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:59.557685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:59.557961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:59.574722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:23:59.575929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:23:59.578155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:59.652548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 491/991] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:23:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:23:59.674956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14a9c-70d2-4881-a7fa-90d3901c18be None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:59.731638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:59.788750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14a9c-70d2-4881-a7fa-90d3901c18be None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:23:59.832505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:23:59.833324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:23:59.833606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:23:59.833881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:23:59.834544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:23:59.835954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:23:59.848887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:23:59.849850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:23:59.856268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 501/992] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:23:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:23:59.857051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:23:59.969829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a69416-934d-47e4-aaa0-81c051d1baa8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:00.008223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:00.008910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.009195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.009471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.010198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:00.010508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:00.011959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:00.018533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 492/993] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:23:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:00.024244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:00.135338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d1950-0ee2-406e-9baa-133f31fd4adc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:00.151409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:00.175582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:00.176296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.176584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.176863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.177578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:00.177884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:00.179287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:00.185210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 502/994] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:24:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:00.191466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:00.194382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:00.297359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1611-fcbd-4763-88dd-90e9aa33f285 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:00.332865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:00.333536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.333819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.334097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.334892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] RBAC: Adding query filter params (interface=public, service_id=a4331182c4f14b308f4c3eb7c7c6570e, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:00.335204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:00.336600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacae97-8e3d-48c1-a887-1ed8c4090be1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:00.342157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 493/995] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:24:00 2022] GET /identity/v3/endpoints?service_id=a4331182c4f14b308f4c3eb7c7c6570e&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:00.347516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:00.457257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe218ca-ed5c-4dfd-9a8f-43cd35fcf48a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:00.496017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba54e4d-6785-4b99-b13f-d7072836d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:00.496699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54e4d-6785-4b99-b13f-d7072836d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.496984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54e4d-6785-4b99-b13f-d7072836d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.497334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54e4d-6785-4b99-b13f-d7072836d5a2 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.497939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba54e4d-6785-4b99-b13f-d7072836d5a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:00.499311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba54e4d-6785-4b99-b13f-d7072836d5a2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:00.506289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 503/996] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:24:00 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:24:00.562727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092cf3-4961-451b-8425-96507f245ed7 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.563084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092cf3-4961-451b-8425-96507f245ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.563293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80092cf3-4961-451b-8425-96507f245ed7 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.565007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 494/997] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:00.570785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.571080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.571362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.590062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:00.591293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:00.635735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:00.675329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 504/998] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:00.698833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80092cf3-4961-451b-8425-96507f245ed7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:00.771826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:00.815448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80092cf3-4961-451b-8425-96507f245ed7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:00.854084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:00.854904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.855186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.856184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:00.857551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a58eed60-695b-4414-a60f-ec6f7cdc8dbd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:00.870518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:00.873316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 09:24:00.875053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:00.877214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 495/999] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 20 09:24:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:00.878512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:00.956467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b485-cea6-402a-ac68-964a9d7aedde None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.956754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b485-cea6-402a-ac68-964a9d7aedde None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.957031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b485-cea6-402a-ac68-964a9d7aedde None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.958391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 496/1000] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:24:00.963572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:00.963895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:00.964174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:00.980851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:00.982035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:00.991952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e6a0-fba4-4ba5-a4c3-7d7ba50477d9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:01.029739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:01.030342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:01.030632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:01.030901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:01.031624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:01.031966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:01.033390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:01.038608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 505/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:24:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:01.044286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:01.062816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 497/1002] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:01.079922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:01.086476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:01.149808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:01.154849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1cb5d-e7db-4e12-82b0-5b50d80c4441 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:01.196666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:01.197345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:01.197524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf578a-e38e-4b65-b04f-d793b36ebc46 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:01.197766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:01.198076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:01.198792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:01.199301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:01.200819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:01.207207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 506/1003] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 20 09:24:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:01.212971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:01.241094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:01.242327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:01.242966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:01.243592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] PATH_INFO: `/v3/services/image` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:01.244328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:01.245753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:01.259295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:01.260750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:01.261754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 498/1004] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 20 09:24:01 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:01.267874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:01.344550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:01.348092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fddf2-bfdb-470e-bf1f-1182edf76f04 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:01.391831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:01.392551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:01.392835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:01.393140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:01.393886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:01.395249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:01.400230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505bc2f-9d49-4363-9524-78d87524a3cd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:01.424302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 507/1005] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:24:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:01.444207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:01.465023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:01.465708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:01.467977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:01.468276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:01.469999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] RBAC: Adding query filter params (name=image) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:01.470328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:01.472932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c116-e156-40de-aedb-960a346bbfbc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:01.478662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 499/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:01.485114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:01.618575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df096-6c9f-4764-8f3e-4a7735fbe6c8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:01.661429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:01.662123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:01.662400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:01.662671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:01.663389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:01.663797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:01.665163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8e561-a7d0-45dc-93d4-8960d19b4ac8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:01.670483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 508/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:02.650363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f29dfe-a092-4a15-a71f-5cda561e40da None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:02.650899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f29dfe-a092-4a15-a71f-5cda561e40da None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:02.650899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f29dfe-a092-4a15-a71f-5cda561e40da None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:02.652450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 500/1008] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:02.658124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:02.658536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:02.658729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:02.675920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:02.677121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:02.697826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:02.752360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 509/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:02.776235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f29dfe-a092-4a15-a71f-5cda561e40da None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:02.893788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f29dfe-a092-4a15-a71f-5cda561e40da None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:02.928520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:02.929247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:02.929531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:02.929803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:02.930459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:02.931839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:02.944134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:02.945140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 09:24:02.945973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:02.948059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 501/1010] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:24:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:02.951398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:03.053845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f138-56df-4646-b7a2-78d54a4db3ec None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:03.087903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:03.088575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.088860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.089139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.089844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:03.090152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:03.091614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:03.101312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 510/1011] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:24:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:03.102935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:03.154659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:03.208974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e70a-74ce-4120-b1ef-9c187b3b92e5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:03.243906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:03.244577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.244860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.245139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.245872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:03.246180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:03.247548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63305e2-5e17-4cc1-8cb2-e687bc187822 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:03.257416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 502/1012] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 20 09:24:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:03.259041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:03.278613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:03.374446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aef59-ec4a-4c82-a053-a7e13c80d97f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:03.409923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843dd8f-5091-4b7e-9e1d-53990f4bc53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:03.410592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843dd8f-5091-4b7e-9e1d-53990f4bc53d None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.410876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843dd8f-5091-4b7e-9e1d-53990f4bc53d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.411156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843dd8f-5091-4b7e-9e1d-53990f4bc53d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.411924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843dd8f-5091-4b7e-9e1d-53990f4bc53d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:03.413297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843dd8f-5091-4b7e-9e1d-53990f4bc53d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:03.438702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 511/1013] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:24:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:03.508898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380aae-c1db-4418-9403-88b670c856a6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.509196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380aae-c1db-4418-9403-88b670c856a6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.509376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380aae-c1db-4418-9403-88b670c856a6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.510772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 503/1014] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:03.517010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135121-9658-4ab0-aa99-2608fecb20e8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.517310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135121-9658-4ab0-aa99-2608fecb20e8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.517578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135121-9658-4ab0-aa99-2608fecb20e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.535799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d5135121-9658-4ab0-aa99-2608fecb20e8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:03.537042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d5135121-9658-4ab0-aa99-2608fecb20e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:03.615586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:03.622917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 512/1015] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:03.647257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380aae-c1db-4418-9403-88b670c856a6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:03.767211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380aae-c1db-4418-9403-88b670c856a6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:03.780360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:03.803374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:03.807754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.807754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.807754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.807754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:03.807754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:03.809158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 504/1016] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:03.811045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950f87b-85e1-4649-8f0f-006b1b1f0048 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.811526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950f87b-85e1-4649-8f0f-006b1b1f0048 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.811611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950f87b-85e1-4649-8f0f-006b1b1f0048 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.813264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 513/1017] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:03.815025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:03.818845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.819200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.819486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.842224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:03.843744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:03.918150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cad75e-1729-4231-aecc-a318ccb104bd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:03.919655 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 514/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:03.943332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:03.961514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134c097-4d04-42b9-8ca1-02ba6c734a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:03.962472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134c097-4d04-42b9-8ca1-02ba6c734a04 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:03.962944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134c097-4d04-42b9-8ca1-02ba6c734a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:03.963405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134c097-4d04-42b9-8ca1-02ba6c734a04 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:03.964750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134c097-4d04-42b9-8ca1-02ba6c734a04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:03.966880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134c097-4d04-42b9-8ca1-02ba6c734a04 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:03.997913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 505/1019] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:24:03 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:04.061146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b3b67-3ed1-4dec-8a79-b9249c190ac9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:04.094107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:04.101930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99303a-5a2d-4f09-aac5-bf7c5c2e5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:04.103081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99303a-5a2d-4f09-aac5-bf7c5c2e5f38 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:04.103557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99303a-5a2d-4f09-aac5-bf7c5c2e5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:04.104038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99303a-5a2d-4f09-aac5-bf7c5c2e5f38 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:04.104971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99303a-5a2d-4f09-aac5-bf7c5c2e5f38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:04.106571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99303a-5a2d-4f09-aac5-bf7c5c2e5f38 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:04.122407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 515/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:24:03 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:05.627641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf8388-af6b-4032-886a-6475b9b310a6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:05.628203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf8388-af6b-4032-886a-6475b9b310a6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:05.628308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf8388-af6b-4032-886a-6475b9b310a6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:05.629791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 506/1021] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:05.634922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:05.635312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:05.635490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:05.653128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:05.654316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:05.728577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 516/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:05.755695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf8388-af6b-4032-886a-6475b9b310a6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:05.787267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:05.868071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf8388-af6b-4032-886a-6475b9b310a6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:05.904423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:05.905156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:05.905443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:05.905720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:05.918309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:05.926689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:05.927581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:05.933340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 507/1023] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 20 09:24:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:05.935957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.041892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8d09-5f57-4b2d-881e-99b7e1263680 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.059080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.079682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.080386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.080662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.080929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.081669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:06.081969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.083325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972544e-0e57-4328-891a-53d4504bbb0e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.096861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 517/1024] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:24:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:06.097977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.112462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e63601-6491-4232-8a2a-8e4da66b8a51 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.112818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e63601-6491-4232-8a2a-8e4da66b8a51 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.113031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e63601-6491-4232-8a2a-8e4da66b8a51 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.114430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 518/1025] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:06.121576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0d77-4c6a-4050-9712-e2bf8e67dd06 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.121874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0d77-4c6a-4050-9712-e2bf8e67dd06 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.122215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0d77-4c6a-4050-9712-e2bf8e67dd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.138932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-24dd0d77-4c6a-4050-9712-e2bf8e67dd06 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:06.140155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-24dd0d77-4c6a-4050-9712-e2bf8e67dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:06.196723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.206664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215f768-93e2-4012-a831-742f737bcbd4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.211391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 519/1026] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:06.214264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649bb7-7ed1-49ec-a73a-b8044ad0b7b6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.214564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649bb7-7ed1-49ec-a73a-b8044ad0b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.214848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649bb7-7ed1-49ec-a73a-b8044ad0b7b6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.216578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 520/1027] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:06.222567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.222860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.223140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.242144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.242967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.243248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.243520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.244436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:06.245641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:06.255001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.256450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:06.273924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:06.274803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:06.275703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:06.275703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:06.275703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:06.275703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:06.275703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 508/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:06.280512 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.313936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 521/1029] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:06.320688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.361368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.381608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463670e2-99e1-465f-93c8-6147a8361310 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.414876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.415670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.415986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.416258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.417430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.418846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.420150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0093-4add-4239-b594-9cf9449cff22 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.420490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 509/1030] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:06.421240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.436380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.458586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.459259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.459546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.459852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.460580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:06.460889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.462267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.474124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 522/1031] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:06.474916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.523959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e38f-7a85-4672-b745-4a46092198cf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.558170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.558959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.559235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.559505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] PATH_INFO: `/v3/services/image` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.560196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.561548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.569692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:06.573047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:06.574212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:06.575066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:06.575901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b45925-d533-42c1-b258-a4b0882090ef None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.575973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 510/1032] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:06.575973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.609553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.610270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.610557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.611121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.612031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.613482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.634240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 523/1033] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:24:06 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:24:06.635057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.663355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.690832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386017c1-1c00-423f-8fae-0f3375d99215 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.729302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.730024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.730312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.732035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.740544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.742013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:24:06.757615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:06.759184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:06.761166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 511/1034] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:06.765097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.783118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ab83-0dda-4332-b298-f87e090c6867 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.830911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.831127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.831238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.831497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.832462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] RBAC: Adding query filter params (name=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:06.833065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.834020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.840135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 524/1035] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:06.846987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.875504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.902518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172a822-2fe1-4707-85e4-7b4641dc5d94 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:06.940477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:06.941318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:06.941604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:06.941883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:06.942739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:06.943305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:06.944514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:06.947975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:06.965171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 512/1036] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:06.970708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:06.972517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20709d38-7872-4118-80e3-7c55e39abd30 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.008632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.009226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.009512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.009790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.010503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] RBAC: Adding query filter params (type=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:07.010814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.012241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.018588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 525/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:07.024285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:07.078475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428739b-9089-48cb-aef7-d382b37bbbe4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.121483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.121741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:07.122522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.122819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.123095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.144498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797e58-e130-4511-bf68-7f586f6679fc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.183888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.184575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.184860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.185144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.185941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] RBAC: Adding query filter params (interface=public, service_id=c2f636bb08a047d1aaf6394d2c9b4325, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:07.186259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.187759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.191570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:07.193700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 526/1038] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:24:07 2022] GET /identity/v3/endpoints?service_id=c2f636bb08a047d1aaf6394d2c9b4325&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:07.199321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:07.201042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.202697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.310129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 513/1039] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:07.310306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a73e8-708d-47b7-8658-87e3638e9ce8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.316260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:07.346804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.347779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.348060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.348334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.349042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.350417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.357222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 527/1040] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:24:07 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:24:07.430548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:07.444664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5cc7-9a4b-437e-84df-b2f7c24ae69d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.484179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.485004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.485827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.486104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.497657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.499136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:07.518760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:07.519812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:07.521565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:07.521565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:07.521565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:07.521565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:07.521565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 514/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:07.527541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:07.542199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:07.631002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7148c-d8a6-4baa-b92a-910ca5c837c8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.665016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.665768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.665968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.666243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.666958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:07.667261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.668709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.681094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 528/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:07.686553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:07.788580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78229a-0a03-4943-b5ff-9a225ed5b4e7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:07.828789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:07.830048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:07.830545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:07.831058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:07.839142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:07.840622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:24:07.855462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:07.856543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:07.857429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 515/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:07.864610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:07.940762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:07.974848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91971cb-3fa4-4a64-82f6-e1ff2458eb88 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:08.009055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:08.009721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:08.010007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:08.010287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:08.011076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:08.011393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:08.013129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229720ad-2fca-44f4-8020-6ab24d321b9b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:08.029896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 529/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:08.031449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:08.041696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:08.135606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129c86-6240-4c1f-ad69-088b533fe0b3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:08.173327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:08.174166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:08.174452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:08.174732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:08.175568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] RBAC: Adding query filter params (role.id=23a9d568e28042159c03d2b4e4c6a05c, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=aebe4b5d4c0c40218341971859875d67) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:08.175912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:08.177357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c5df1-9241-4d83-94d9-fee20dc62cf7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:08.192068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 516/1045] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:08 2022] GET /identity/v3/role_assignments?user.id=aebe4b5d4c0c40218341971859875d67&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=23a9d568e28042159c03d2b4e4c6a05c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:08.815923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18709e05-b84b-4242-ab98-ed03d3edefde None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:08.816442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18709e05-b84b-4242-ab98-ed03d3edefde None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:08.816541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18709e05-b84b-4242-ab98-ed03d3edefde None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:08.818006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 530/1046] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:08.823255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:08.824612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:08.824612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:08.843185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:08.844400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:08.912513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:08.918288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 517/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:08.943122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18709e05-b84b-4242-ab98-ed03d3edefde None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.048309 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18709e05-b84b-4242-ab98-ed03d3edefde None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.076981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:09.084777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.085583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.085869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.086147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.097487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:09.105122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:09.106020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:09.106835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:09.111759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 531/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:09.112306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.214158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8888-cceb-414c-9128-1013d1288c99 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.247497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.248201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.248487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.248767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.249584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:09.249893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:09.251853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:09.265034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 518/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:09.266285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.370353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d606b9-b438-4faa-892d-5bce3a5dd1e1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.406881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f208e-0983-44ac-bbaf-300a9994cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.407741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f208e-0983-44ac-bbaf-300a9994cdcd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.408043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f208e-0983-44ac-bbaf-300a9994cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.408322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f208e-0983-44ac-bbaf-300a9994cdcd None admin] PATH_INFO: `/v3/users/df03e96c784a49129c13c42a4d6adfbd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.421749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f208e-0983-44ac-bbaf-300a9994cdcd None admin] RBAC: Authorizing `identity:get_user(user_id=df03e96c784a49129c13c42a4d6adfbd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:09.423262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f208e-0983-44ac-bbaf-300a9994cdcd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:09.429598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 532/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/users/df03e96c784a49129c13c42a4d6adfbd => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:09.430590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.434815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b7007-00d6-4bb8-aac6-2ac5c1e25017 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.435102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b7007-00d6-4bb8-aac6-2ac5c1e25017 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.435387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b7007-00d6-4bb8-aac6-2ac5c1e25017 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.436892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 533/1051] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:09.442668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.443081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.443366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.461508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:09.462712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:09.499505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:09.515544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:09.542465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 534/1052] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:09.544259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd91395-149b-4c63-87df-8b2fd3db2a26 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.566096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.580584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.581506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.582034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.582497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.658243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:09.659597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:09.672025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a46203-7f2b-4d4d-8015-cc3abaad9503 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.709269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.710073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.710354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.710629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] PATH_INFO: `/v3/services/image` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.711471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:09.712686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:09.724762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:09.726969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:09.728184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 09:24:09.729005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:09.733292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 535/1053] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:09.734032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.769985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 519/1054] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:24:09.777311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.790576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:09.861170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e9075-0de3-418b-b509-6d46ee43c7de None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.901670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336b33-29dc-4d2f-be3c-33254c56f42d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:09.902198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.902670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.902953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.903230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.903991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] RBAC: Adding query filter params (name=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:09.904304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:09.905698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:09.915944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 536/1055] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:09.916961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.939447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:09.940346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:09.940628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:09.940901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:09.942212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] RBAC: Authorizing `identity:get_project(project_id=85c825532d4e4dbdab485511ec8758b5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:09.943632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:09.945350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 520/1056] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:09.951156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:09.983104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:10.034538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25abf-9386-4c7e-8d18-2bd1ee0f8bcf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:10.042193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:10.058511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf0e9-baad-411d-b150-da74d254bc8b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:10.071363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:10.072058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.072337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.072607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.073462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] RBAC: Adding query filter params (type=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:10.073769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:10.075125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:10.080671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 537/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:10.086279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:10.095878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:10.096545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.096831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.097109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.097948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=85c825532d4e4dbdab485511ec8758b5, user.id=df03e96c784a49129c13c42a4d6adfbd) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:10.098262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:10.099697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae177f-a3eb-4fa9-a602-2a101ddadd02 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:10.105498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 521/1058] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:09 2022] GET /identity/v3/role_assignments?user.id=df03e96c784a49129c13c42a4d6adfbd&scope.project.id=85c825532d4e4dbdab485511ec8758b5&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:10.199377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c00af-9e84-40a1-bef6-0a868ad7de76 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:10.235682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:10.236408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.236690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.236964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.237723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:10.237824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642898a-9334-48f8-a8fb-8b155268c7ec None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.238075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642898a-9334-48f8-a8fb-8b155268c7ec None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.238360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642898a-9334-48f8-a8fb-8b155268c7ec None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.239113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:10.239973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 522/1059] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:24:10.245791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.246361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.246850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.262270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 538/1060] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:24:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:10.270750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:10.272128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:10.355491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 523/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:10.380066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:10.410782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:10.492662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae6b98-a485-4ceb-8308-c981bb48cd42 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:10.528732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:10.529556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.529842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.530121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.540894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:10.549703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:10.550614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:24:10.551428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:10.552676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 539/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 20 09:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:10.557304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:10.580135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:10.668637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9d8ca-7183-47a7-8898-fe83bcc483e1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:10.704237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:10.704913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.705198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.705474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.706224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:10.706537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:10.707924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:10.721487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 524/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:10.723438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:10.815950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:10.837357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8adf48-e05f-4153-ae9d-45d387353b61 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:10.872333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:10.873164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:10.873413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:10.873685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:10.890176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:10.891682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:10.909432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:10.910328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:10.911225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:10.911225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:10.911225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:10.911225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:10.911225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 540/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:10.916781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:11.001389 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:11.021254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6768bc4-b387-4bf3-92b4-774980ff4e29 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:11.054978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:11.055649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:11.055959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:11.056236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:11.056952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:11.057258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:11.058617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:11.075135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 525/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:11.076818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:11.179792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471c035-4402-45ce-bd13-ea1a61177484 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:11.216296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:11.217126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:11.217406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:11.217682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:11.227553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:11.229061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:11.231352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:24:11.246115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:11.247329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:11.252931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 541/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:24:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:11.256191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:11.356998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33380-f9c3-4740-a122-039f79e192d2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:11.394726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:11.395409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:11.395694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:11.396002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:11.396853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:11.397159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:11.398601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:11.419152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:11.430119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 526/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:24:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:11.432054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:11.539247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8656a6a-c182-406c-98ad-dbe612df2601 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:11.573313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:11.574113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:11.574397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:11.574671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:11.585530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:11.586978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:11.604407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:11.605326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:11.611554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:11.611554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:11.611554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:11.611554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:11.611554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 542/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:11.613308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:11.714786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67b44-bf76-4f1f-9159-75c2f78bbf8a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:11.751131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:11.751819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:11.752105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:11.752378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:11.753101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:11.753406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:11.754760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:11.770955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 527/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:11.772737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:11.835069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:11.890116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58429-a8f6-4ca0-89f9-cdc58fee9a85 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:11.927065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:11.927918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:11.928207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:11.928484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:11.935940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:11.937398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:24:11.953529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:11.954990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:24:11.955899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:11.960181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 543/1070] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:11.961429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.024144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.066976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0523c-b644-4207-afa9-0c81cfa95465 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.102631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.103292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.103572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.103870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.104641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:12.104945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:12.106358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03b837-bb70-4f02-bbbe-160c609e1d86 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:12.119343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 528/1071] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:12.125006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.160571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fed72-f818-4179-a754-f0a1a327af4d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.160842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fed72-f818-4179-a754-f0a1a327af4d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.161051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fed72-f818-4179-a754-f0a1a327af4d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.162428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 529/1072] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:24:12.167372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.167663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.167971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.186232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:12.187684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:12.232830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a7031-cd5b-43a7-bd34-fbffe07f1096 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.245599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.260718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 530/1073] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:12.273803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da25df6-1ad3-4d98-ae4b-cebda938db3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.274707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da25df6-1ad3-4d98-ae4b-cebda938db3a None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.274992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da25df6-1ad3-4d98-ae4b-cebda938db3a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.275275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da25df6-1ad3-4d98-ae4b-cebda938db3a None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/aebe4b5d4c0c40218341971859875d67/roles/23a9d568e28042159c03d2b4e4c6a05c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.277506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da25df6-1ad3-4d98-ae4b-cebda938db3a None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=aebe4b5d4c0c40218341971859875d67, role_id=23a9d568e28042159c03d2b4e4c6a05c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:12.278990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da25df6-1ad3-4d98-ae4b-cebda938db3a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:12.284107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.302986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 544/1074] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:24:12 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/aebe4b5d4c0c40218341971859875d67/roles/23a9d568e28042159c03d2b4e4c6a05c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:24:12.341583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.386634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5b1b-f44d-4b79-ae03-aa0f0076c61f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.386967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5b1b-f44d-4b79-ae03-aa0f0076c61f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.387194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5b1b-f44d-4b79-ae03-aa0f0076c61f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.389095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 545/1075] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:24:12.394602 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.394897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.395174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.402275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c9f6b-be60-4f63-b5a7-72d303fd6390 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.413775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:12.415202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:12.443312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.444345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.444632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.444905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.459435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:12.467996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:12.468981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:12.470339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 531/1076] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:12.476252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.494259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 546/1077] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:12.517154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.594346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a056f-dcc3-44c0-8308-5d1d32a1ba57 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.606943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.619172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.623096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90883dae-3625-4c9c-857d-cf8fb4badb01 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.635209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.635948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.636232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.636694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.637255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:12.637822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:12.639222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:12.653586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 532/1078] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:12.654798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.663440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.664184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.664412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.664682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.746031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:12.747558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:12.776627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58552fe-59b5-46db-b8e4-0dfda86eaa19 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.816755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.817639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.817928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.818323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] PATH_INFO: `/v3/users/df03e96c784a49129c13c42a4d6adfbd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.819548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] RBAC: Authorizing `identity:get_user(user_id=df03e96c784a49129c13c42a4d6adfbd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:12.821073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:12.827711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 533/1079] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:12 2022] GET /identity/v3/users/df03e96c784a49129c13c42a4d6adfbd => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:12.829328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.859458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.863887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 547/1080] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:24:12.869053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:12.883066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:12.949238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7acfd-47c4-44cb-bba6-cd5555b6732f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.983664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88537bc8-e839-4f58-9f1f-63acafa528a0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:12.987248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:12.988146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:12.988432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:12.988709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:12.989903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=85c825532d4e4dbdab485511ec8758b5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:12.991484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:12.998092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 534/1081] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:12 2022] GET /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:12.999086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:13.024285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:13.025089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:13.025375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:13.025653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:13.036339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:13.037788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:13.056041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:13.056977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:13.062706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:13.062706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:13.062706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:13.062706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:13.062706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 548/1082] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:13.063517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:13.121024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:13.123905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1fd2-22ad-45e5-99d5-7835be4d6bf6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:13.135219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:13.162819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55189-7cdc-4dd3-ab47-d46b25258bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:13.163705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55189-7cdc-4dd3-ab47-d46b25258bec None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:13.164063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55189-7cdc-4dd3-ab47-d46b25258bec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:13.164415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55189-7cdc-4dd3-ab47-d46b25258bec None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5/users/df03e96c784a49129c13c42a4d6adfbd/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:13.166480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55189-7cdc-4dd3-ab47-d46b25258bec None admin] RBAC: Authorizing `identity:create_grant(project_id=85c825532d4e4dbdab485511ec8758b5, user_id=df03e96c784a49129c13c42a4d6adfbd, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:13.168140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55189-7cdc-4dd3-ab47-d46b25258bec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:13.170667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b4d5c-d654-4676-984b-583d49b4faf0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:13.191925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 535/1083] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:24:12 2022] PUT /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5/users/df03e96c784a49129c13c42a4d6adfbd/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:24:13.208116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:13.208827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:13.209114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:13.209391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:13.210136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:13.210450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:13.211899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecfe72-05d4-4bce-a665-a99a7bf6924b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:13.225570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 549/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:14.336758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1c60-c0c6-436e-9b10-843c44aca86a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:14.337286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1c60-c0c6-436e-9b10-843c44aca86a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:14.337406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1c60-c0c6-436e-9b10-843c44aca86a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:14.338684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 536/1085] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:14.344109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:14.345075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:14.345268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:14.362600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:14.363829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:14.429701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 550/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:14.454449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1c60-c0c6-436e-9b10-843c44aca86a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:14.555549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1c60-c0c6-436e-9b10-843c44aca86a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:14.587684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:14.588444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:14.588722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:14.588994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:14.599199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:14.607279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:14.608470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:14.609309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 537/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 20 09:24:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:14.615327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:14.658474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:14.717321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704817db-ba9a-4fa6-8275-5201ebdc5a1f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:14.751673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:14.752365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:14.752638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:14.752907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:14.753644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:14.753943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:14.755297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:14.763488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 551/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:24:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:14.769396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:14.798269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:14.871354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d05b5-9427-4beb-a22a-4d94bfcc058d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:14.908430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:14.909220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:14.909584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:14.909772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:14.920217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:14.921639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:14.940424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:14.941365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:14.942238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:14.942238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:14.942238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:14.942238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:14.942238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 538/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:14.947424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.045329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1fa5-e709-4e25-9a61-dc7bd4717fe5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.048146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.086043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.086850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.087128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.087448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.088357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:15.088645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.090276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80f3c1-efa6-4b6e-84f3-46c622dc2cd1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.103157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 552/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:15.110325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.191699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.214908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374f294-52eb-4ecb-bf35-d37b9ce78cbd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.243671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff780f4-d1a2-4012-a7c8-de98a68c279c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.243997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff780f4-d1a2-4012-a7c8-de98a68c279c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.244280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff780f4-d1a2-4012-a7c8-de98a68c279c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.245654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 553/1091] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:24:15.249241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.250047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.250330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.250625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.250730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.250943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.251226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.259205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.260673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.267662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:15.268887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:24:15.275181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:15.276209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:15.277174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 539/1092] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:15.282710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.335940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 554/1093] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:24:15.359534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.382852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7009-afe8-43d4-99e4-3cbd3df5629d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.416677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.417345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.417627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.417905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.418743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:15.419050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.420509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.430263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.438626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 540/1094] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:15.444639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.455866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.462978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdff20d-7fdc-4cac-a54e-35d61025fc67 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.497880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.498679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.498964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.499243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.509324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:15.517307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:15.518439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:15.519663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 555/1095] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:15.524379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.546402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c7e0-75b5-4cb4-963e-110072da3c7a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.580683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.581335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.581621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.581903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.624985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d69a4-f100-4008-b0db-8356800a5b4a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.645453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.649467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.650916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.659550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.660257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.660544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.660823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.661576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:15.661886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.663251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.671411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 556/1096] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:15.677195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.694954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.748501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 541/1097] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:24:15.754648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.777522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed96e9-36f8-46a4-abaa-2f4475d67cf1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.811156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.812067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.812352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.812630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] PATH_INFO: `/v3/users/df03e96c784a49129c13c42a4d6adfbd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.813876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] RBAC: Authorizing `identity:get_user(user_id=df03e96c784a49129c13c42a4d6adfbd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.815314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.817007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 557/1098] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/users/df03e96c784a49129c13c42a4d6adfbd => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:15.822584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.855567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.859293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d37916-61c7-40e3-b815-92aa691a8927 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.896033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.896826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.897107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.897379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:15.908033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:15.909351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:15.909465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:15.925465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f23e-849b-49c5-bbb8-f758fdbeba54 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:15.927018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:15.927966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:15.929045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:24:15.929045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:15.929045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:24:15.929045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:15.929045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 542/1099] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:15.933932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:15.962588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:15.963240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:15.963520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:15.963848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.032666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.034098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ec0c-f462-4e93-94a8-0e3e647ad4dc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:16.034207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.068715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:16.069375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:16.069660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:16.069935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.070652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:16.070959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.072365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.084485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 543/1100] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:16.090133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:16.101936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:16.118649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:16.138368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 558/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:24:16.144270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:16.194279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b55b36-e0b8-4798-a843-71db5c8d9cfa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:16.227080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:16.227928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:16.228217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:16.228488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.235007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.236465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.244712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9684cb7-9d86-4a33-877c-3ef4661e6cad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:24:16.250840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:16.251770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:16.252686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 544/1102] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:24:16.257871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:16.280974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:16.281865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:16.282149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:16.282432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.283618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] RBAC: Authorizing `identity:get_project(project_id=85c825532d4e4dbdab485511ec8758b5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.285097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.286807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 559/1103] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:16 2022] GET /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:16.293131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:16.326319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:16.345222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:16.356564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d457cc-b0eb-47a1-ac09-1d2697d3e07d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:16.390836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:16.392013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:16.392299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:16.392576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.393353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:16.393662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.394202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2042-9dc1-4d88-9213-cbbefc475e74 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:16.395095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.406562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 545/1104] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:16.413091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:16.428988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:16.429654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:16.429940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:16.430224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.431057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=85c825532d4e4dbdab485511ec8758b5, user.id=df03e96c784a49129c13c42a4d6adfbd) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:16.431370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.432837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a2420-aa23-4e3a-a7e9-b06a81bc98fb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.438750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 560/1105] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:16 2022] GET /identity/v3/role_assignments?user.id=df03e96c784a49129c13c42a4d6adfbd&scope.project.id=85c825532d4e4dbdab485511ec8758b5&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:16.519183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc31c3-2bf6-4515-a7a1-dfcc59541dd6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:16.549273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:16.555816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:16.556442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:16.556719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:16.556997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:16.557843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] RBAC: Adding query filter params (role.id=23a9d568e28042159c03d2b4e4c6a05c, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=aebe4b5d4c0c40218341971859875d67) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:16.558150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:16.559578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c41f1-5af4-4b3a-9e48-c127a41f09f7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:16.566182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 546/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:16 2022] GET /identity/v3/role_assignments?user.id=aebe4b5d4c0c40218341971859875d67&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=23a9d568e28042159c03d2b4e4c6a05c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:18.492641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80041c-26b2-4565-bf7a-8e221d6acc49 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:18.493174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80041c-26b2-4565-bf7a-8e221d6acc49 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:18.493174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80041c-26b2-4565-bf7a-8e221d6acc49 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:18.494554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 561/1107] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:18.499796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:18.500193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:18.500360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:18.517832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:18.519036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:18.585341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 547/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:18.610724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80041c-26b2-4565-bf7a-8e221d6acc49 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:18.710087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80041c-26b2-4565-bf7a-8e221d6acc49 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:18.729138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:18.750743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529502-972d-44c2-a3e4-4886304d75f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:18.751462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529502-972d-44c2-a3e4-4886304d75f7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:18.751765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529502-972d-44c2-a3e4-4886304d75f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:18.752040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529502-972d-44c2-a3e4-4886304d75f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:18.753241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529502-972d-44c2-a3e4-4886304d75f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:18.754674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529502-972d-44c2-a3e4-4886304d75f7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:18.756356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 562/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:18.763110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:18.867249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e62b8-496f-4ae6-949d-eb65a475f95a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:18.891992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:18.903076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5195c-86a6-4e6f-adf7-c46f27a2cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:18.903774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5195c-86a6-4e6f-adf7-c46f27a2cc4e None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:18.904065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5195c-86a6-4e6f-adf7-c46f27a2cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:18.904345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5195c-86a6-4e6f-adf7-c46f27a2cc4e None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:18.905045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5195c-86a6-4e6f-adf7-c46f27a2cc4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:18.907065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5195c-86a6-4e6f-adf7-c46f27a2cc4e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:18.926003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 548/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:24:18 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:20.978751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9992d-6b73-496a-b10f-f2219a652957 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:20.979328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9992d-6b73-496a-b10f-f2219a652957 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:20.979328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9992d-6b73-496a-b10f-f2219a652957 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:20.980713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 563/1111] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:20.985880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526711-e48f-404a-85fd-976f81617306 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:20.986275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526711-e48f-404a-85fd-976f81617306 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:20.986438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526711-e48f-404a-85fd-976f81617306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:21.002774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f1526711-e48f-404a-85fd-976f81617306 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:21.004001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f1526711-e48f-404a-85fd-976f81617306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:21.068878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 549/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:21.093299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9992d-6b73-496a-b10f-f2219a652957 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:21.196279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9992d-6b73-496a-b10f-f2219a652957 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:21.231930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:21.232832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:21.233149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:21.233481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] PATH_INFO: `/v3/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:21.235029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] RBAC: Authorizing `identity:get_role(role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:21.236423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:21.237813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 564/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:21 2022] GET /identity/v3/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:21.243815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526711-e48f-404a-85fd-976f81617306 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:21.339095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526711-e48f-404a-85fd-976f81617306 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:21.349368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:21.372008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:21.372876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:21.373154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:21.373425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] PATH_INFO: `/v3/users/d562cb6894404e6b98738fa8e336c076` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:21.386718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] RBAC: Authorizing `identity:get_user(user_id=d562cb6894404e6b98738fa8e336c076)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:21.388420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:21.390048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 550/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:21 2022] GET /identity/v3/users/d562cb6894404e6b98738fa8e336c076 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:21.396491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:21.447097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:21.493478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342943a-ced5-4f00-8c57-7c62b5d3cb88 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:21.526729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:21.527366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:21.527649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:21.527950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:21.591701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:21.593148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:21.643207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:21.689661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 565/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:21.695554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:21.791959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb28589-bd47-4cfc-b005-f118cf4b2e0f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:21.824930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff41d2-3252-48eb-9fc6-af82cafd859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:21.825799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff41d2-3252-48eb-9fc6-af82cafd859a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:21.826081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff41d2-3252-48eb-9fc6-af82cafd859a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:21.826356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff41d2-3252-48eb-9fc6-af82cafd859a None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:21.827550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff41d2-3252-48eb-9fc6-af82cafd859a None admin] RBAC: Authorizing `identity:get_project(project_id=85c825532d4e4dbdab485511ec8758b5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:21.829565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff41d2-3252-48eb-9fc6-af82cafd859a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:21.831260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 551/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:21 2022] GET /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:21.837324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:21.938308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ad067-1ae1-4f93-b1bb-2567313ef755 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:21.972192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:21.972850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:21.973136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:21.973414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:21.974240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] RBAC: Adding query filter params (role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=85c825532d4e4dbdab485511ec8758b5, user.id=d562cb6894404e6b98738fa8e336c076) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:21.974555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:21.976014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c016a-a0da-42b8-a0dd-a2acb076ec18 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:21.981431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 566/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:21 2022] GET /identity/v3/role_assignments?user.id=d562cb6894404e6b98738fa8e336c076&scope.project.id=85c825532d4e4dbdab485511ec8758b5&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:24.017669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c636-d4b3-411b-8751-58072019cdc2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:24.018222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c636-d4b3-411b-8751-58072019cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:24.018222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c636-d4b3-411b-8751-58072019cdc2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:24.019582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 552/1118] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:24.024861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:24.025272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:24.025417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:24.042357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:24.043549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:24.054037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:24.110878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 567/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:24.133669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c636-d4b3-411b-8751-58072019cdc2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:24.169917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:24.240788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c636-d4b3-411b-8751-58072019cdc2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:24.278261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:24.279118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:24.279407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:24.279685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] PATH_INFO: `/v3/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:24.281217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] RBAC: Authorizing `identity:get_role(role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:24.282586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:24.284000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 553/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:24 2022] GET /identity/v3/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:24.289982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:24.384999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ab733-1b3b-461a-8fad-b588dd0fff4c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:24.418260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:24.419135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:24.419417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:24.419690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] PATH_INFO: `/v3/users/d562cb6894404e6b98738fa8e336c076` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:24.420911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] RBAC: Authorizing `identity:get_user(user_id=d562cb6894404e6b98738fa8e336c076)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:24.422381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:24.424046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 568/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:24 2022] GET /identity/v3/users/d562cb6894404e6b98738fa8e336c076 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:24.429806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:24.527482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e93fd-6a5a-4884-bd0d-5ce26e7f10ac None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:24.529759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:24.560540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e382-5063-43f4-9ffe-8cec1270068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:24.561399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e382-5063-43f4-9ffe-8cec1270068b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:24.561682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e382-5063-43f4-9ffe-8cec1270068b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:24.561958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e382-5063-43f4-9ffe-8cec1270068b None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:24.563661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e382-5063-43f4-9ffe-8cec1270068b None admin] RBAC: Authorizing `identity:get_project(project_id=85c825532d4e4dbdab485511ec8758b5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:24.565137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e382-5063-43f4-9ffe-8cec1270068b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:24.566854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 554/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:24 2022] GET /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:24.572835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:24.588423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:24.676012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3cbc0-72d8-4ed7-bbf5-930d755df670 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:24.709635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a869ae-130f-499b-b980-97d4087e3e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:24.710520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a869ae-130f-499b-b980-97d4087e3e0b None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:24.710808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a869ae-130f-499b-b980-97d4087e3e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:24.711087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a869ae-130f-499b-b980-97d4087e3e0b None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5/users/d562cb6894404e6b98738fa8e336c076/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:24.713308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a869ae-130f-499b-b980-97d4087e3e0b None admin] RBAC: Authorizing `identity:create_grant(project_id=85c825532d4e4dbdab485511ec8758b5, user_id=d562cb6894404e6b98738fa8e336c076, role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:24.714741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a869ae-130f-499b-b980-97d4087e3e0b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:24.727432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 569/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:24:24 2022] PUT /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5/users/d562cb6894404e6b98738fa8e336c076/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:24:26.723192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2566c-ae28-456a-a56a-8f9be5fc68bf None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:26.723768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2566c-ae28-456a-a56a-8f9be5fc68bf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:26.723768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2566c-ae28-456a-a56a-8f9be5fc68bf None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:26.725123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 555/1124] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:26.730138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:26.730581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:26.730685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:26.747662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:26.748879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:26.816754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 570/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:26.840653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2566c-ae28-456a-a56a-8f9be5fc68bf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:26.941475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2566c-ae28-456a-a56a-8f9be5fc68bf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:26.975155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:26.975964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:26.976249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:26.976523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] PATH_INFO: `/v3/roles/1d3e80642b284c45a82ddd991cbb0d78` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:26.977998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] RBAC: Authorizing `identity:get_role(role_id=1d3e80642b284c45a82ddd991cbb0d78)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:26.979356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:26.980745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 556/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:26 2022] GET /identity/v3/roles/1d3e80642b284c45a82ddd991cbb0d78 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:26.986606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:26.989804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:27.083442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61aa4-c467-4b29-af70-ba56fc735db3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:27.116255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:27.117124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:27.117406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:27.117682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] PATH_INFO: `/v3/users/d562cb6894404e6b98738fa8e336c076` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:27.118865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] RBAC: Authorizing `identity:get_user(user_id=d562cb6894404e6b98738fa8e336c076)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:27.120333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:27.121960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 571/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:26 2022] GET /identity/v3/users/d562cb6894404e6b98738fa8e336c076 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:27.127796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:27.169776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:27.225552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d7334-be30-4846-a8c6-5480876eaa2b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:27.258026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:27.258670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:27.258955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:27.259233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:27.323608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:27.325070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:27.363891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:27.420281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 557/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:27.426857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:27.497162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:27.526575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea861c9a-2330-45ff-a537-1b4e2838d4fd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:27.561689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e797d5-d370-46a0-b965-644ffd30941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:27.562587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e797d5-d370-46a0-b965-644ffd30941e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:27.562866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e797d5-d370-46a0-b965-644ffd30941e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:27.563137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e797d5-d370-46a0-b965-644ffd30941e None admin] PATH_INFO: `/v3/projects/85c825532d4e4dbdab485511ec8758b5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:27.564335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e797d5-d370-46a0-b965-644ffd30941e None admin] RBAC: Authorizing `identity:get_project(project_id=85c825532d4e4dbdab485511ec8758b5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:27.565862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e797d5-d370-46a0-b965-644ffd30941e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:27.567551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 572/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:27 2022] GET /identity/v3/projects/85c825532d4e4dbdab485511ec8758b5 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:27.573773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:27.671255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dce1a-6f7f-44a2-9abd-4aa73250f07f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:27.703935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:27.704585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:27.704870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:27.705147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:27.705971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] RBAC: Adding query filter params (role.id=1d3e80642b284c45a82ddd991cbb0d78, scope.project.id=85c825532d4e4dbdab485511ec8758b5, user.id=d562cb6894404e6b98738fa8e336c076) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:27.706284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:27.707699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f162-ec98-40e8-9e79-b5525ac9705d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:27.713400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 558/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:27 2022] GET /identity/v3/role_assignments?user.id=d562cb6894404e6b98738fa8e336c076&scope.project.id=85c825532d4e4dbdab485511ec8758b5&role.id=1d3e80642b284c45a82ddd991cbb0d78 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:24:29.762599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8f14-616f-4a49-ac63-6033a7995004 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:29.763125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8f14-616f-4a49-ac63-6033a7995004 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:29.763244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8f14-616f-4a49-ac63-6033a7995004 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:29.764583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 573/1131] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:29.770568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:29.770975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:29.771121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:29.777045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:29.788987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:29.790162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:29.856936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 559/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:29.882197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8f14-616f-4a49-ac63-6033a7995004 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:29.982198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8f14-616f-4a49-ac63-6033a7995004 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:30.016688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab870-aabb-4598-a4ea-4099e478ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:30.017415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab870-aabb-4598-a4ea-4099e478ab05 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:30.017701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab870-aabb-4598-a4ea-4099e478ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:30.017980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab870-aabb-4598-a4ea-4099e478ab05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:30.019157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab870-aabb-4598-a4ea-4099e478ab05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:30.020624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab870-aabb-4598-a4ea-4099e478ab05 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:30.022224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 574/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:30.028164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:30.122916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493007a-4478-47e2-b0a6-c04858fd464f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:30.157321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bb467-88c2-43f3-ba3c-68a92f03666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:30.157974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bb467-88c2-43f3-ba3c-68a92f03666a None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:30.158257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bb467-88c2-43f3-ba3c-68a92f03666a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:30.158531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bb467-88c2-43f3-ba3c-68a92f03666a None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:30.159246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bb467-88c2-43f3-ba3c-68a92f03666a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:30.160686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bb467-88c2-43f3-ba3c-68a92f03666a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:30.163931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:30.185485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 560/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:24:30 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:24:32.251639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ec05-eb75-4cce-8be1-5b958185ef6c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:32.252229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ec05-eb75-4cce-8be1-5b958185ef6c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:32.252229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ec05-eb75-4cce-8be1-5b958185ef6c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:32.253584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 575/1135] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:32.258738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:32.259178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:32.259364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:32.276451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:32.277629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:32.349106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 561/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:32.373165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ec05-eb75-4cce-8be1-5b958185ef6c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:32.384221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:32.482009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ec05-eb75-4cce-8be1-5b958185ef6c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:32.514887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cf235-391a-4c54-b007-e6e10515bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:32.516256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf235-391a-4c54-b007-e6e10515bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:32.516534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf235-391a-4c54-b007-e6e10515bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:32.516804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf235-391a-4c54-b007-e6e10515bb6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:32.517974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf235-391a-4c54-b007-e6e10515bb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:32.519399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf235-391a-4c54-b007-e6e10515bb6a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:32.521055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 576/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:24:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:32.527033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:32.620914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3ee2-1811-4a8c-ba2a-f4ad701e2ebb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:32.636972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:32.667226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342599-573a-4044-80d5-f5a850d39ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:32.667957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342599-573a-4044-80d5-f5a850d39ba3 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:32.668247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342599-573a-4044-80d5-f5a850d39ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:32.668523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342599-573a-4044-80d5-f5a850d39ba3 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:32.669263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342599-573a-4044-80d5-f5a850d39ba3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:32.670702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342599-573a-4044-80d5-f5a850d39ba3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:32.698045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 562/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:24:32 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:24:34.785792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6950c-6d01-4291-8d39-7826d58881a7 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:34.786356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6950c-6d01-4291-8d39-7826d58881a7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:34.786356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6950c-6d01-4291-8d39-7826d58881a7 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:34.787763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 577/1139] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:34.792839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:34.793260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:34.793384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:34.810994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:34.812653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:34.878821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 563/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:34.903583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6950c-6d01-4291-8d39-7826d58881a7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:34.985546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:35.009247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6950c-6d01-4291-8d39-7826d58881a7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:35.042415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:35.043139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:35.043422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:35.043697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:35.054321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:35.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:35.063159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:35.064287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 578/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:35.069281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:35.166827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bec90f-df4c-4c0b-bae1-1e27205f9751 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:35.168332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:35.200002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:35.200663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:35.200945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:35.201219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:35.201966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:35.202271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:35.204197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:35.211972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 564/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:35.217811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:35.318403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf0b69-55ed-498a-b028-32db640b54a1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:35.352169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:35.353040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:35.353325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:35.353602 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] PATH_INFO: `/v3/users/3d6d5257d1c341219c77ed856e6f166b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:35.356392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:35.367434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5257d1c341219c77ed856e6f166b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:35.368911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:35.370587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 579/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:35 2022] GET /identity/v3/users/3d6d5257d1c341219c77ed856e6f166b => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:35.376414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:35.476739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8465c-ff93-4b22-a475-b10573b0c052 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:35.509497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:35.510143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:35.510428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:35.510707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:35.540551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:35.576501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:35.577965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:35.673983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 565/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:35.679994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:35.776489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02191bd-3059-4c0e-bc42-9db4732f0764 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:35.809836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb467e6-d690-417f-a051-abe373471abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:35.810701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb467e6-d690-417f-a051-abe373471abc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:35.810986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb467e6-d690-417f-a051-abe373471abc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:35.811263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb467e6-d690-417f-a051-abe373471abc None admin] PATH_INFO: `/v3/projects/4174b50b64904d609865b1042cf8372b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:35.813011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb467e6-d690-417f-a051-abe373471abc None admin] RBAC: Authorizing `identity:get_project(project_id=4174b50b64904d609865b1042cf8372b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:35.814439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb467e6-d690-417f-a051-abe373471abc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:35.816176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 580/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:35 2022] GET /identity/v3/projects/4174b50b64904d609865b1042cf8372b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:35.822658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:35.881585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:35.918471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8d6ee-a7d5-4332-8055-afe136c825e1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:35.952761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:35.953412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:35.953701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:35.953957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:35.954778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=4174b50b64904d609865b1042cf8372b, user.id=3d6d5257d1c341219c77ed856e6f166b) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:35.955088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:35.956687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4df7-02fa-45f1-beea-ed8525bc0192 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:35.962050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 566/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:35 2022] GET /identity/v3/role_assignments?user.id=3d6d5257d1c341219c77ed856e6f166b&scope.project.id=4174b50b64904d609865b1042cf8372b&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:37.968202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaae36-b16c-406c-8884-a564a9c072d7 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:37.968748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaae36-b16c-406c-8884-a564a9c072d7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:37.968748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaae36-b16c-406c-8884-a564a9c072d7 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:37.970158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 581/1147] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:37.976104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:37.976613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:37.976707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:37.997702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:37.999113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:38.069122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 567/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:38.091642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaae36-b16c-406c-8884-a564a9c072d7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:38.152755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:38.196964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaae36-b16c-406c-8884-a564a9c072d7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:38.229957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:38.230744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:38.231023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:38.231294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:38.242634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:38.250798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:38.251929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:38.252884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 582/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:38.258071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:38.315559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:38.356595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75725211-24a5-42be-8776-3acbbe34ceac None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:38.390070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:38.390735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:38.391019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:38.391292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:38.392059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:38.392365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:38.393727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:38.401510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 568/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:38.407906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:38.506221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0c10-f840-4095-aa2f-eb076ad70545 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:38.527836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:38.539808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:38.540682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:38.540967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:38.541246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] PATH_INFO: `/v3/users/3d6d5257d1c341219c77ed856e6f166b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:38.542431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5257d1c341219c77ed856e6f166b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:38.543892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:38.545534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 583/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:38 2022] GET /identity/v3/users/3d6d5257d1c341219c77ed856e6f166b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:38.552053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:38.648221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c6c4-6799-4181-b670-e2c034d756e0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:38.667401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:38.681797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578ee2a-98f9-443d-ae65-453f5e0bb7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:38.682658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ee2a-98f9-443d-ae65-453f5e0bb7dd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:38.682937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ee2a-98f9-443d-ae65-453f5e0bb7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:38.683206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ee2a-98f9-443d-ae65-453f5e0bb7dd None admin] PATH_INFO: `/v3/projects/4174b50b64904d609865b1042cf8372b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:38.684382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578ee2a-98f9-443d-ae65-453f5e0bb7dd None admin] RBAC: Authorizing `identity:get_project(project_id=4174b50b64904d609865b1042cf8372b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:38.685820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578ee2a-98f9-443d-ae65-453f5e0bb7dd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:38.687504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 569/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:38 2022] GET /identity/v3/projects/4174b50b64904d609865b1042cf8372b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:38.693589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:38.796822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff384cf-80b8-4b9f-ba6b-5dd66212e64e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:38.831643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb62d2-797e-4ebd-b392-fb29db1f7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:38.832780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb62d2-797e-4ebd-b392-fb29db1f7a6f None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:38.833157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb62d2-797e-4ebd-b392-fb29db1f7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:38.833440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb62d2-797e-4ebd-b392-fb29db1f7a6f None admin] PATH_INFO: `/v3/projects/4174b50b64904d609865b1042cf8372b/users/3d6d5257d1c341219c77ed856e6f166b/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:38.836255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb62d2-797e-4ebd-b392-fb29db1f7a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=4174b50b64904d609865b1042cf8372b, user_id=3d6d5257d1c341219c77ed856e6f166b, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:38.837704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb62d2-797e-4ebd-b392-fb29db1f7a6f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:38.851140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 584/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:24:38 2022] PUT /identity/v3/projects/4174b50b64904d609865b1042cf8372b/users/3d6d5257d1c341219c77ed856e6f166b/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:24:40.839260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596f18-d3f6-4331-a1e3-460c917f7d89 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:40.839695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596f18-d3f6-4331-a1e3-460c917f7d89 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:40.839848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596f18-d3f6-4331-a1e3-460c917f7d89 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:40.841205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 570/1154] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:40.846388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:40.846823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:40.846944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:40.863737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:40.864941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:40.918741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:40.940426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 585/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:40.963889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596f18-d3f6-4331-a1e3-460c917f7d89 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:41.063676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596f18-d3f6-4331-a1e3-460c917f7d89 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:41.096612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:41.097333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:41.097618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:41.097897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:41.107781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:41.115984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:41.117076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:41.118163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 571/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:41.123289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:41.220263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164fee0-3849-415f-bcea-e810ef2e7f96 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:41.253698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:41.254370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:41.254650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:41.254926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:41.255674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:41.256007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:41.257381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:41.266133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 586/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:41.271974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:41.319366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:41.369067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4d41-3fe7-48bf-87de-c76fac7a5cf4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:41.402469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:41.403329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:41.403609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:41.403910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] PATH_INFO: `/v3/users/3d6d5257d1c341219c77ed856e6f166b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:41.405098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5257d1c341219c77ed856e6f166b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:41.407526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:41.409682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 572/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:41 2022] GET /identity/v3/users/3d6d5257d1c341219c77ed856e6f166b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:41.415512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:41.461728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:41.519324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffed49-721c-47b8-a344-859a82ce0de9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:41.552306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:41.552956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:41.553245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:41.553527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:41.618960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:41.620543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:41.666653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:41.727285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 587/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:41.733210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:41.830989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e489f6f-5473-4407-835c-026ca7a7612f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:41.846487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:41.864595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47fe3-e1c4-4a39-8a27-e58405c767cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:41.865446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47fe3-e1c4-4a39-8a27-e58405c767cc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:41.865726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47fe3-e1c4-4a39-8a27-e58405c767cc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:41.865999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47fe3-e1c4-4a39-8a27-e58405c767cc None admin] PATH_INFO: `/v3/projects/4174b50b64904d609865b1042cf8372b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:41.867169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd47fe3-e1c4-4a39-8a27-e58405c767cc None admin] RBAC: Authorizing `identity:get_project(project_id=4174b50b64904d609865b1042cf8372b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:41.868609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd47fe3-e1c4-4a39-8a27-e58405c767cc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:41.870275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 573/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:41 2022] GET /identity/v3/projects/4174b50b64904d609865b1042cf8372b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:41.876847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:41.976507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499104ff-3460-4453-b53f-6dfe23cbd54d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:42.014086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:42.015703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:42.016240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:42.016747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:42.018320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=4174b50b64904d609865b1042cf8372b, user.id=3d6d5257d1c341219c77ed856e6f166b) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:42.018900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:42.021003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2a8b9-9838-4b6c-88ee-1ad62d78893d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:42.029081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 588/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:41 2022] GET /identity/v3/role_assignments?user.id=3d6d5257d1c341219c77ed856e6f166b&scope.project.id=4174b50b64904d609865b1042cf8372b&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:44.075255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786779-5183-44f1-bd67-379046cb8a75 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:44.075802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786779-5183-44f1-bd67-379046cb8a75 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:44.075895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786779-5183-44f1-bd67-379046cb8a75 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:44.077706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 574/1162] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:44.083061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:44.083446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:44.083566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:44.095068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:44.101016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:44.102196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:44.168403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 589/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:44.190478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786779-5183-44f1-bd67-379046cb8a75 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:44.289266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786779-5183-44f1-bd67-379046cb8a75 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:44.321566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:44.322200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:44.322477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:44.322746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:44.376795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:44.394270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:44.395731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:44.492149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 575/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:44.498192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:44.594267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd7cc-82bc-4441-854e-b0fc2f38a20c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:44.627085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:44.627848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:44.628134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:44.628411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:44.631094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:44.635694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:44.637579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ffaa51d2-9878-4a46-a884-638730feed4f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:44.652199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:44.654236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:24:44.655789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 590/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:24:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:44.659738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:44.743865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:44.760233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f8e5-9082-44d0-8c02-81531920e445 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:44.794163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:44.794823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:44.795103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:44.795379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:44.796641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:44.796952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:44.798310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abc71f-9b58-4855-a547-bef5ed880188 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:44.805397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 576/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 20 09:24:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:46.790958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a866c-6b51-4488-95f6-45325bdd6e68 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:46.791517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a866c-6b51-4488-95f6-45325bdd6e68 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:46.791517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a866c-6b51-4488-95f6-45325bdd6e68 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:46.792902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 591/1167] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:46.798609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570027d-22ba-47e4-91d9-46899c28aa51 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:46.799011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570027d-22ba-47e4-91d9-46899c28aa51 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:46.799174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570027d-22ba-47e4-91d9-46899c28aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:46.815681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b570027d-22ba-47e4-91d9-46899c28aa51 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:46.816904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b570027d-22ba-47e4-91d9-46899c28aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:46.882606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 577/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:46.906246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a866c-6b51-4488-95f6-45325bdd6e68 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:47.010383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a866c-6b51-4488-95f6-45325bdd6e68 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:47.043168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a92d0-67a4-4f8a-b61d-a1f24cca03d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:47.043786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a92d0-67a4-4f8a-b61d-a1f24cca03d9 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:47.044075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a92d0-67a4-4f8a-b61d-a1f24cca03d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:47.044356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a92d0-67a4-4f8a-b61d-a1f24cca03d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:47.045097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a92d0-67a4-4f8a-b61d-a1f24cca03d9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:47.047088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a92d0-67a4-4f8a-b61d-a1f24cca03d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:47.061553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 592/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Jul 20 09:24:46 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:24:49.135510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae9554-8aa1-4acc-8858-31c1fe226795 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:49.136070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae9554-8aa1-4acc-8858-31c1fe226795 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:49.136070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae9554-8aa1-4acc-8858-31c1fe226795 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:49.137726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 578/1170] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:49.143773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:49.144242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:49.144388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:49.161344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:49.162541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:49.211706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:49.229462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 593/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:49.252892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae9554-8aa1-4acc-8858-31c1fe226795 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:49.330517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:49.352960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae9554-8aa1-4acc-8858-31c1fe226795 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:49.386544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9002efb-637f-4478-9d6c-a026fe79666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:49.387592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9002efb-637f-4478-9d6c-a026fe79666b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:49.387914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9002efb-637f-4478-9d6c-a026fe79666b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:49.388193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9002efb-637f-4478-9d6c-a026fe79666b None admin] PATH_INFO: `/v3/domains/47c7228405a24fea8af48faec54e113f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:49.398394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9002efb-637f-4478-9d6c-a026fe79666b None admin] RBAC: Authorizing `identity:get_domain(domain_id=47c7228405a24fea8af48faec54e113f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:49.399871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9002efb-637f-4478-9d6c-a026fe79666b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:49.401498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 579/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Jul 20 09:24:49 2022] GET /identity/v3/domains/47c7228405a24fea8af48faec54e113f => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:49.407384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:49.504299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05641-18d9-4f34-946b-eee6b6b24edf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:49.538064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f696-a86b-46da-a1c2-1e605773933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:49.538727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f696-a86b-46da-a1c2-1e605773933b None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:49.539012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f696-a86b-46da-a1c2-1e605773933b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:49.539293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f696-a86b-46da-a1c2-1e605773933b None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:49.540041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f696-a86b-46da-a1c2-1e605773933b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:49.541471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7f696-a86b-46da-a1c2-1e605773933b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:49.566816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 594/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:24:49 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:24:51.629645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbac25-a75b-4ea6-a8b7-4e2da3c73911 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:51.630201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbac25-a75b-4ea6-a8b7-4e2da3c73911 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:51.630201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbac25-a75b-4ea6-a8b7-4e2da3c73911 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:51.631565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 580/1174] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:51.636927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:51.637592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:51.637739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:51.654753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:51.656611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:51.685510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:51.724313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 595/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:51.748539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbac25-a75b-4ea6-a8b7-4e2da3c73911 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:51.858847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbac25-a75b-4ea6-a8b7-4e2da3c73911 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:51.892226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431df6-fbfd-4e55-9920-52c239f47b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:51.893021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431df6-fbfd-4e55-9920-52c239f47b0a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:51.893307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431df6-fbfd-4e55-9920-52c239f47b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:51.893583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431df6-fbfd-4e55-9920-52c239f47b0a None admin] PATH_INFO: `/v3/domains/47c7228405a24fea8af48faec54e113f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:51.894777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb431df6-fbfd-4e55-9920-52c239f47b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=47c7228405a24fea8af48faec54e113f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:51.896242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb431df6-fbfd-4e55-9920-52c239f47b0a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:51.897853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 581/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Jul 20 09:24:51 2022] GET /identity/v3/domains/47c7228405a24fea8af48faec54e113f => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:51.903645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:52.000980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ccf3f-a62a-4040-ac09-901a8f3565cb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:52.034481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca7b92-9cc5-4d17-b1f1-387a1d2d2ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:52.035157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca7b92-9cc5-4d17-b1f1-387a1d2d2ad3 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:52.035443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca7b92-9cc5-4d17-b1f1-387a1d2d2ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:52.035736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca7b92-9cc5-4d17-b1f1-387a1d2d2ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:52.036447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca7b92-9cc5-4d17-b1f1-387a1d2d2ad3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:52.037879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca7b92-9cc5-4d17-b1f1-387a1d2d2ad3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:52.057062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 596/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:24:51 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:24:54.200078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797180b8-4679-4a14-b7a8-6e27aa7503ed None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:54.200580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797180b8-4679-4a14-b7a8-6e27aa7503ed None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:54.200580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797180b8-4679-4a14-b7a8-6e27aa7503ed None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:54.202512 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 582/1178] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:54.208247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:54.208690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:54.208794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:54.225261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:54.226451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:54.243267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:54.293445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 597/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:54.317635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797180b8-4679-4a14-b7a8-6e27aa7503ed None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:54.326511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:54.417382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797180b8-4679-4a14-b7a8-6e27aa7503ed None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:54.450043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:54.450879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:54.451138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:54.451411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:54.461712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:54.469259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:54.470381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:54.471439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 583/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:54.476639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:54.572886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569eff6-dacd-48ca-94e4-2849a30a4a20 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:54.607117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:54.607831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:54.608142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:54.608420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:54.609172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:54.609483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:54.610855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:54.618781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 598/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:54.624592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:54.694469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:54.730340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0cb2-fe60-4f83-8dd1-33471af0c13f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:54.764113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:54.765005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:54.765288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:54.765563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] PATH_INFO: `/v3/users/da6e85581ab44818ac15102df2114160` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:54.778169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] RBAC: Authorizing `identity:get_user(user_id=da6e85581ab44818ac15102df2114160)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:54.779604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:54.782458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 584/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:54 2022] GET /identity/v3/users/da6e85581ab44818ac15102df2114160 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:54.789815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:54.813608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:54.907429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e2c0-efdb-4211-a83e-e825c3115df3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:54.941354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:54.942001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:54.942285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:54.942565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:55.009305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:55.010677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:55.027973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:55.108938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 599/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:24:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:24:55.121114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:55.221049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb9b9a-9b5b-4853-8d26-4a2fdffaaa08 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:55.243500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:55.254899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2edea7-9402-4cad-a28d-6ea9a190a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:55.255797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2edea7-9402-4cad-a28d-6ea9a190a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:55.256086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2edea7-9402-4cad-a28d-6ea9a190a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:55.256364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2edea7-9402-4cad-a28d-6ea9a190a8b5 None admin] PATH_INFO: `/v3/projects/d77f9da4098f46db96c62f63c1f67157` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:55.257576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2edea7-9402-4cad-a28d-6ea9a190a8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d77f9da4098f46db96c62f63c1f67157)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:55.259007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2edea7-9402-4cad-a28d-6ea9a190a8b5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:55.260793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 585/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:55 2022] GET /identity/v3/projects/d77f9da4098f46db96c62f63c1f67157 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:55.267859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:55.362946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f42e-3a80-461f-9acd-ec790990e54e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:55.379506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:55.397121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:55.397765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:55.398044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:55.398317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:55.399130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=d77f9da4098f46db96c62f63c1f67157, user.id=da6e85581ab44818ac15102df2114160) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:55.399437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:55.400887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501ab31-e13f-4321-9a24-2a50a1f6ffb3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:55.406227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 600/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:24:55 2022] GET /identity/v3/role_assignments?user.id=da6e85581ab44818ac15102df2114160&scope.project.id=d77f9da4098f46db96c62f63c1f67157&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:57.408191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19a79-1092-4102-825b-a2b6e00a579d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:57.408753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19a79-1092-4102-825b-a2b6e00a579d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:57.408753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19a79-1092-4102-825b-a2b6e00a579d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:57.410112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 586/1186] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:24:57.415205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:57.415620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:57.415780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:57.432997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:24:57.434193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:24:57.498691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 601/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:24:57.522161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef19a79-1092-4102-825b-a2b6e00a579d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:57.622953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef19a79-1092-4102-825b-a2b6e00a579d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:57.657196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:57.657979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:57.658314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:57.659347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:57.669569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:24:57.677213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:24:57.678458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:24:57.679834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 587/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:24:57.684551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:57.784490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67534f-cb53-407c-b86f-9067445a6cf7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:57.794846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:57.823299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:57.824014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:57.824299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:57.824578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:57.825335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:24:57.825643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:57.827591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:57.836217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 602/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:57.841969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:57.894291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:57.941272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda5b6-1ad1-4508-8638-7ad0a044cca9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:57.973554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:57.974417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:57.974701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:57.974974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] PATH_INFO: `/v3/users/da6e85581ab44818ac15102df2114160` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:57.976178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] RBAC: Authorizing `identity:get_user(user_id=da6e85581ab44818ac15102df2114160)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:57.977641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:57.979238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 588/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:24:57 2022] GET /identity/v3/users/da6e85581ab44818ac15102df2114160 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:57.985267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:58.084445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d51d3-84f7-4680-b3a5-1e37294a92a2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:58.116908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65d9db-4650-4b44-8d86-3f62b3f2e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:58.117760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65d9db-4650-4b44-8d86-3f62b3f2e767 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:58.118041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65d9db-4650-4b44-8d86-3f62b3f2e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:58.118313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65d9db-4650-4b44-8d86-3f62b3f2e767 None admin] PATH_INFO: `/v3/projects/d77f9da4098f46db96c62f63c1f67157` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:58.119520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65d9db-4650-4b44-8d86-3f62b3f2e767 None admin] RBAC: Authorizing `identity:get_project(project_id=d77f9da4098f46db96c62f63c1f67157)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:58.120982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65d9db-4650-4b44-8d86-3f62b3f2e767 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:58.122673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 603/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:24:57 2022] GET /identity/v3/projects/d77f9da4098f46db96c62f63c1f67157 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:24:58.129134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:24:58.226789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f44db-b90f-4a2b-9566-99ef5f6062a7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:24:58.246096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:24:58.259884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb37d-e401-4b4d-9981-26d19b71bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:24:58.260770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb37d-e401-4b4d-9981-26d19b71bc78 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:24:58.261057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb37d-e401-4b4d-9981-26d19b71bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:24:58.261335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb37d-e401-4b4d-9981-26d19b71bc78 None admin] PATH_INFO: `/v3/projects/d77f9da4098f46db96c62f63c1f67157/users/da6e85581ab44818ac15102df2114160/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:24:58.263525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb37d-e401-4b4d-9981-26d19b71bc78 None admin] RBAC: Authorizing `identity:create_grant(project_id=d77f9da4098f46db96c62f63c1f67157, user_id=da6e85581ab44818ac15102df2114160, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:24:58.265035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb37d-e401-4b4d-9981-26d19b71bc78 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:24:58.277502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 589/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:24:58 2022] PUT /identity/v3/projects/d77f9da4098f46db96c62f63c1f67157/users/da6e85581ab44818ac15102df2114160/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:25:00.308043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf83b2-80b9-4b14-9a19-8a8922dc59e3 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:00.308580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf83b2-80b9-4b14-9a19-8a8922dc59e3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:00.308580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf83b2-80b9-4b14-9a19-8a8922dc59e3 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:00.309992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 604/1193] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:25:00.315858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:00.316305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:00.316400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:00.333453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:25:00.334645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:25:00.400958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 590/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:25:00.425638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf83b2-80b9-4b14-9a19-8a8922dc59e3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:00.470762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:00.530432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf83b2-80b9-4b14-9a19-8a8922dc59e3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:00.562696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:00.563427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:00.563712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:00.564016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:00.575082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:25:00.583243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:25:00.584473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:25:00.585350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 605/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:25:00.590636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:00.690008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4f279-4489-4d64-accf-dfe85426ebe1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:00.700862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:00.726441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:00.727112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:00.727396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:00.727673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:00.728454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:25:00.728765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:00.730149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:00.738310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 591/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:25:00.744191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:00.841495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:00.845558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df0c6-4759-4861-bb51-a85d51d2bc21 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:00.879466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:00.880446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:00.880734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:00.881015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] PATH_INFO: `/v3/users/da6e85581ab44818ac15102df2114160` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:00.882234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] RBAC: Authorizing `identity:get_user(user_id=da6e85581ab44818ac15102df2114160)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:00.883735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:00.885417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 606/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 20 09:25:00 2022] GET /identity/v3/users/da6e85581ab44818ac15102df2114160 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:25:00.892156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:00.994596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b884fe-ec2b-443e-87a2-cb2d2abdbf2a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:01.030947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:01.031606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:01.031924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:01.032200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:01.072943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:01.099506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:01.100916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:01.202049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 592/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:25:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:25:01.208218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:01.315845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fecf7b-420e-4bb2-800c-3e3af1b8bc79 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:01.347870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cffa6-3d9d-44b1-bc68-addf5c1a9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:01.348719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cffa6-3d9d-44b1-bc68-addf5c1a9c5d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:01.348999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cffa6-3d9d-44b1-bc68-addf5c1a9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:01.349273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cffa6-3d9d-44b1-bc68-addf5c1a9c5d None admin] PATH_INFO: `/v3/projects/d77f9da4098f46db96c62f63c1f67157` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:01.350481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cffa6-3d9d-44b1-bc68-addf5c1a9c5d None admin] RBAC: Authorizing `identity:get_project(project_id=d77f9da4098f46db96c62f63c1f67157)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:01.351872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cffa6-3d9d-44b1-bc68-addf5c1a9c5d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:01.353552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 607/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 20 09:25:01 2022] GET /identity/v3/projects/d77f9da4098f46db96c62f63c1f67157 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:25:01.360392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:01.427236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:01.456316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf3df7-0e85-46e1-9235-59bca04b5e2f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:01.489121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:01.489764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:01.490053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:01.490329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:01.491151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=d77f9da4098f46db96c62f63c1f67157, user.id=da6e85581ab44818ac15102df2114160) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:25:01.491458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:01.492902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade86c-064b-45e0-8eb3-a63d1867a109 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:01.499136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 593/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:25:01 2022] GET /identity/v3/role_assignments?user.id=da6e85581ab44818ac15102df2114160&scope.project.id=d77f9da4098f46db96c62f63c1f67157&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:25:11.344224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:11.495959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=32 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:57.734756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df2a-2fa5-4bd8-a4d6-6ac6ce57ecab None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:57.735506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df2a-2fa5-4bd8-a4d6-6ac6ce57ecab None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:57.735506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df2a-2fa5-4bd8-a4d6-6ac6ce57ecab None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:57.737010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 608/1201] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:25:57.742921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:57.743430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:57.743595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:57.763750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:25:57.765291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:25:57.860338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 594/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:25:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 09:25:57.888544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3df2a-2fa5-4bd8-a4d6-6ac6ce57ecab None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:58.015709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3df2a-2fa5-4bd8-a4d6-6ac6ce57ecab None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:58.056563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:58.057409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:58.057696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:58.058542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:58.071350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:58.072900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:25:58.094722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:25:58.096078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:25:58.102024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:25:58.102024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:25:58.102024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:25:58.102024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:25:58.102024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 609/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:25:58.102594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:58.231536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb7360-0f18-4597-8faf-d344cfdbb66b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:58.278639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:58.286704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:58.287579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:58.288014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:58.291249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:58.291249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:25:58.291249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:58.291249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64bd0-3e78-4b68-8c4a-660ef0657104 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:58.306024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 595/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:25:58.312447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:25:58.379694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:58.445386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175b70c-84a9-4a8e-990b-7d851c6de61a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:25:58.494584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a794-fa10-43c1-ab1a-56b4f0737065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:25:58.495440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a794-fa10-43c1-ab1a-56b4f0737065 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:25:58.495742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a794-fa10-43c1-ab1a-56b4f0737065 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:25:58.496058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a794-fa10-43c1-ab1a-56b4f0737065 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:25:58.496830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9a794-fa10-43c1-ab1a-56b4f0737065 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:25:58.498410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9a794-fa10-43c1-ab1a-56b4f0737065 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:25:58.525489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 610/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 20 09:25:58 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:26:00.877322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c00ef-a8d0-4116-bcd1-673e5d98fa81 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:00.877322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c00ef-a8d0-4116-bcd1-673e5d98fa81 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:00.878044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c00ef-a8d0-4116-bcd1-673e5d98fa81 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:00.879220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 596/1206] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:00.886890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:00.887525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:00.887525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:00.908374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:00.909785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:01.002676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 611/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:01.031490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c00ef-a8d0-4116-bcd1-673e5d98fa81 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:01.174111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c00ef-a8d0-4116-bcd1-673e5d98fa81 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:01.228218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:01.229049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:01.229334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:01.229701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:01.244317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:26:01.254299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:01.255331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:01.256208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 597/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:01.263752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:01.313601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:01.388723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b0aa1-4132-4830-89e1-74013fee2b8c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:01.431675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:01.432427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:01.433304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:01.433629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:01.434470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:01.434848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:01.436660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:01.448129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 612/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:01.455402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:01.524987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:01.591831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d6c8-b77d-4085-8111-5b427d4085c6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:01.637885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:01.639206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:01.639485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:01.639797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:01.655320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:01.657034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:01.679436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:01.685276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:01.686459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:01.686459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:01.686459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:01.686459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:01.686459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 598/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:01.688702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:01.815529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c1900-8dc6-4404-b8af-addace983c5e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:01.817187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:01.863568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:01.864645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:01.865106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:01.865502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:01.867009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:01.867623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:01.869468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:01.902982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 613/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:01.909183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:02.038483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ff1c-1d08-4483-a5a7-e8dcbf580469 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:02.040383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:02.085434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:02.086364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:02.086687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:02.086967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:02.096344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:02.097801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:26:02.121037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:02.122094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:02.123424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 599/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:02.129292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:02.284464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c362e-010e-4847-ac55-fdd02544f4a5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:02.330750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:02.331456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:02.331757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:02.332097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:02.332905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:02.333213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:02.334667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:02.353266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 614/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 20 09:26:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:02.360364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:02.498207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b0a6-7290-4bb1-9afb-fccf828f69b9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:02.539851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:02.540784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:02.541073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:02.541355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:02.580283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:02.626879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:02.628750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:02.760511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 600/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:26:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:26:02.767684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:02.791325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:02.900037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94e227-12af-47fa-9017-5215fce0f00a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:02.942011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:02.942011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:02.942011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:02.942011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:02.955576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:02.957313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:02.977520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:02.978787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:02.985880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:02.985880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:02.985880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:02.985880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:02.985880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 615/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:02.987960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:03.066499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:03.132302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5210-d781-4d53-ba41-4d53f7ebdd5b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:03.184552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:03.185336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:03.185722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:03.186167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:03.187003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:03.187391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:03.189159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:03.202855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 601/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:03.209151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:03.314375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:03.393988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7ce2-4e71-4b8a-ac7a-191492262162 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:03.439580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:03.440395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:03.440685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:03.441018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:03.449652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:03.451078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:26:03.469743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:03.470761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:03.476949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 616/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:03.478522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:03.594168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4e5c-9e71-420d-976c-c20ed80cb698 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:03.619264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:03.640250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:03.640937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:03.641410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:03.641587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:03.642719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:03.643076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:03.644867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620b5ce-ed52-4659-b885-18cd672759ec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:03.671468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 602/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:03.673149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:03.792582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe1d88-a349-4910-8431-703bcbedc610 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:03.824218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:03.837459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:03.838847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:03.839828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:03.840438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:03.842091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=4ad02dfcd1184ef690f171ac4410381f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:03.842658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:03.845000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e93554-856e-473c-992f-058af1b2073e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:03.853284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 617/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:26:03 2022] GET /identity/v3/role_assignments?user.id=4ad02dfcd1184ef690f171ac4410381f&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:06.160467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f730c-74cf-4ede-ae10-9b6a43934494 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:06.161029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f730c-74cf-4ede-ae10-9b6a43934494 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:06.161165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f730c-74cf-4ede-ae10-9b6a43934494 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:06.163104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 603/1220] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:06.169855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:06.170352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:06.170528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:06.187971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:06.189181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:06.259131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 618/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:06.284140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f730c-74cf-4ede-ae10-9b6a43934494 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:06.394597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f730c-74cf-4ede-ae10-9b6a43934494 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:06.436062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:06.436870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:06.437166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:06.437473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:06.449945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:26:06.459081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:06.460773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:06.462091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 604/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:06.467633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:06.577331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91876e04-c990-43ed-bc87-2b4d74e5f09c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:06.602821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:06.614164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:06.614852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:06.615133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:06.615410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:06.616200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:06.616506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:06.617869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:06.626939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 619/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:06.633207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:06.684219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:06.746064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e45a8-d51b-436d-bec1-b45e2da3679b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:06.781194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:06.782005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:06.782287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:06.782564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:06.794099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:06.795562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:06.818760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:06.819972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:06.821085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:06.821085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:06.821085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:06.821085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:06.821085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 605/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:06.826975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:06.937942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afea5e6-c0b5-4f5f-a2eb-e30a8e7a9c7e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:06.973306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:06.974424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:06.974424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:06.974646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:06.975213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:06.975539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:06.976930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:06.990610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 620/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:06.996752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:07.100804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:07.110036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c032f-4ea8-45eb-a2e0-b75bc498ca75 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:07.146629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:07.147467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:07.147863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:07.148146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:07.156606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:07.158107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:26:07.173148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:07.174730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:07.175674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 606/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:07.180927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:07.233125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:07.300580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943494-4b67-4c7b-83cc-962905a441b0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:07.342430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:07.343202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:07.343519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:07.343830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:07.344796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:07.345147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:07.346923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:07.369102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 621/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 20 09:26:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:26:07.376585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:07.493466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d775d-f649-4b56-afb9-e8885424765b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:07.531185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:07.532247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:07.532632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:07.532842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:07.546305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:07.547929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:07.569803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:07.570924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:07.577048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:07.577048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:07.577048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:07.577048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:07.577048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 607/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:07.577325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:07.714066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105eef9-d68f-460b-b5bf-44a0e591a885 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:07.716703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:07.753274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:07.753935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:07.754269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:07.754653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:07.755496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:07.755910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:07.757542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:07.770313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 622/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:07.776811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:07.786851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:07.891500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe95be-3f11-420a-823a-cdce5f57a537 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:07.926708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:07.927575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:07.927882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:07.928157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:07.935955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:07.937411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:26:07.957831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:07.959120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:07.960186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 608/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:07.967083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:08.079662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764544-25ed-464c-8163-4f4d65973c8b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:08.117799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:08.118509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:08.118879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:08.119158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:08.120055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:08.120373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:08.122116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc4c7e-1ad8-4f6c-9c7c-7e1e57842a2b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:08.136172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 623/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:26:08.143968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:08.232320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:08.270449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa35bcd-1384-4290-8fcc-6ad0d85506fd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:08.315179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd03e1-84b0-4abc-ac83-d0d73bfd6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:08.316136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd03e1-84b0-4abc-ac83-d0d73bfd6578 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:08.316412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd03e1-84b0-4abc-ac83-d0d73bfd6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:08.316687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd03e1-84b0-4abc-ac83-d0d73bfd6578 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/4ad02dfcd1184ef690f171ac4410381f/roles/0c610fab75c94da9a399b43c9661bcbf` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:08.335370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd03e1-84b0-4abc-ac83-d0d73bfd6578 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=4ad02dfcd1184ef690f171ac4410381f, role_id=0c610fab75c94da9a399b43c9661bcbf)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:08.336783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd03e1-84b0-4abc-ac83-d0d73bfd6578 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:08.349971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 609/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:26:08 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/4ad02dfcd1184ef690f171ac4410381f/roles/0c610fab75c94da9a399b43c9661bcbf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:26:10.570132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05f57-555a-40d3-a8ea-76cfc708eb83 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:10.570663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05f57-555a-40d3-a8ea-76cfc708eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:10.570772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05f57-555a-40d3-a8ea-76cfc708eb83 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:10.572106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 624/1233] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:26:10.577438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:10.577867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:10.578043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:10.596044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:10.597274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:10.671972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 610/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:10.700369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05f57-555a-40d3-a8ea-76cfc708eb83 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:10.730407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:10.819549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05f57-555a-40d3-a8ea-76cfc708eb83 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:10.858062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:10.858860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:10.859147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:10.859420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:10.871055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:26:10.878947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:10.880196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:10.881132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 625/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 20 09:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:10.887001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:10.939371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:11.000606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8f5af-dd33-4679-9fdf-68c5c98fc2a1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:11.038151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:11.038982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:11.039277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:11.040133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:11.040330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:11.040634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:11.042565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:11.050981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 611/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 20 09:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:11.056716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:11.150657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:11.169075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ce703-55da-4a85-b5e1-7f4235eebb0e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:11.206356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:11.207174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:11.207481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:11.207878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:11.219919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:11.221680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:11.243060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:11.244329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:11.245726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:11.245726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:11.245726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:11.245726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:11.245726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 626/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:11.251254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:11.364583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639d628-291f-494c-8ba2-73c6d817d0d9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:11.374346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:11.404377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:11.405032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:11.405342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:11.405706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:11.406501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:11.406881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:11.408452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:11.422835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 612/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:11.429124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:11.555173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f27f4-2661-47c0-acfc-761e8e227316 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:11.594870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:11.595693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:11.596002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:11.596273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:11.599117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:11.605758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:11.607492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:26:11.624202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:11.625331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:11.626259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 627/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:11.632050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:11.746250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f356-1146-4d88-bf98-bf0611885ff2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:11.784964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:11.785779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:11.786096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:11.786408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:11.787305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:11.787619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:11.789102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:11.812092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 613/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 20 09:26:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:11.818598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:11.934051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549326-b101-49a1-95a7-c2ae50183938 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:11.974562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:11.975234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:11.975526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:11.975832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:12.041176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:12.049505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:12.051135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:12.172228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 628/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:26:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:26:12.178063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:12.209233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:12.297761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921b351-1a1c-4b36-ba47-8c01269a86e7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:12.339648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:12.340483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:12.341999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:12.341999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:12.352310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:12.354050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:12.378989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:12.380022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:12.381314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:12.381314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:12.381314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:12.381314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:12.381314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 614/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:12.388342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:12.527912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:12.534275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e997c-e9a3-44d9-97cc-4f2aac2600f6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:12.574067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:12.574757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:12.575093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:12.575417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:12.576286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:12.576599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:12.578148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:12.590487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 629/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:12.596529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:12.685616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:12.716354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae559-ae26-481c-ad0b-a0b0f27581ad None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:12.754232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:12.755034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:12.755317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:12.755592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:12.762628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:12.764090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:26:12.779443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:12.780673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:12.782119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 615/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:12.787265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:12.908058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6193-a6dc-4e69-af54-d4aeafc1de6f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:12.945909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:12.946513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:12.946798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:12.947076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:12.948443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:12.948755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:12.950237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7943a-e0b8-4a87-91b5-5b349621c81a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:12.969311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 630/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:26:12.970783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:13.089418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803723-64ce-4f72-bf88-9820b9979676 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:13.125868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:13.126561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:13.126851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:13.127131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:13.128021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] RBAC: Adding query filter params (role.id=0c610fab75c94da9a399b43c9661bcbf, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=4ad02dfcd1184ef690f171ac4410381f) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:13.128365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:13.129963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78870c-a239-4ae9-a9e8-3e6b82d679a1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:13.137209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 616/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:26:12 2022] GET /identity/v3/role_assignments?user.id=4ad02dfcd1184ef690f171ac4410381f&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=0c610fab75c94da9a399b43c9661bcbf => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:15.442224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2ec9-7f38-43c1-bc55-f9b27bb8d78c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:15.442856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2ec9-7f38-43c1-bc55-f9b27bb8d78c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:15.443027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2ec9-7f38-43c1-bc55-f9b27bb8d78c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:15.444469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 631/1247] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:15.449947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:15.450424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:15.450544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:15.456350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:15.472426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:15.473827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:15.562471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 617/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:15.590121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2ec9-7f38-43c1-bc55-f9b27bb8d78c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:15.612577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:15.717879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2ec9-7f38-43c1-bc55-f9b27bb8d78c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:15.762268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:15.763093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:15.763400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:15.763780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:15.774663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:26:15.783093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:15.784290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:15.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 632/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:15.791144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:15.913520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee05d-85ff-4421-92b0-ff93a64da4de None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:15.949362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:15.955143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:15.956266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:15.956862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:15.957334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:15.958445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:15.958798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:15.960221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:15.976098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 618/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:26:15.977230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:16.072629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:16.099994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4bf7a-410b-416d-9258-0628de780b92 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:16.139698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:16.140592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:16.140905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:16.141223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:16.153431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:16.154980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:16.173842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:16.174930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:16.176079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:16.176079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:16.176079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:16.176079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:16.176079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 633/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:16.181322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:16.295602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accb7d-b3c9-4983-b97f-ab397d18918c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:16.333063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:16.333876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:16.334131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:16.334484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:16.335374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:16.335749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:16.337340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:16.350998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 619/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:16.356973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:16.472515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f55e-d647-455c-82e0-34bb9d157dfa None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:16.500204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:16.508772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:16.509572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:16.509855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:16.510768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:16.519041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:16.520528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:26:16.535462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:16.536646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:16.538028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 634/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:16.542652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:16.609198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:16.662726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47736bac-f42a-4a34-8c3d-cfc203134e3f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:16.701162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:16.701836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:16.702115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:16.702394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:16.703224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:16.703526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:16.705015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:16.725467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 620/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 20 09:26:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:16.731937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:16.851894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0defad0-37df-417a-82d9-d4a0032c63af None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:16.891765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:16.892392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:16.892706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:16.893008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:16.955261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:16.970533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:16.972095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:17.080430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 635/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:26:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 09:26:17.087001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:17.203594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943ce6-2ad2-4a7d-b121-ea7d889a4abb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:17.220643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:17.246682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:17.247508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:17.247819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:17.248096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:17.258520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:17.260575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:17.280295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:17.281420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:17.282332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:17.282332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:17.282332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:17.282332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:17.282332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 621/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:17.288420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:17.407392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:17.421789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3b99-a84f-4084-85ba-2602b4e926fc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:17.460107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:17.460921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:17.461204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:17.461507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:17.462342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:17.462777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:17.464272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:17.478851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 636/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:17.485579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:17.603114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5309d-0734-456d-969e-ee6e513bb8c1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:17.642809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:17.643699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:17.644013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:17.644294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:17.651654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:17.653223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:26:17.668020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:17.669143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:17.670222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 622/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:17.675456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:17.793697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c354c63-55d2-4ee1-8086-dada4df7a4f3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:17.832405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:17.833078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:17.833352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:17.833619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:17.834406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:17.834717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:17.836183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda072ee-da5f-4bb2-988c-c0897a155c23 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:17.851762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 637/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:17.856362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:17.885119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:17.966101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3a417-3c11-4fd4-b1f6-e162e41c4e2a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:18.003239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:18.003959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:18.004319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:18.004521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:18.005363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=4ad02dfcd1184ef690f171ac4410381f) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:18.005674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:18.007161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a5f49-f0b6-4576-81ce-60fe7db68082 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:18.013947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 623/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:26:17 2022] GET /identity/v3/role_assignments?user.id=4ad02dfcd1184ef690f171ac4410381f&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=2e997984fe364ad8afd717716e701a23 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:20.051288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf5b93-1c1c-4719-8f0b-fadef8c1730f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.051883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf5b93-1c1c-4719-8f0b-fadef8c1730f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.051883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf5b93-1c1c-4719-8f0b-fadef8c1730f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.053263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 638/1261] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:20.058914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.059330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.059461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.076542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:20.077767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:20.141298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 624/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:20.164496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf5b93-1c1c-4719-8f0b-fadef8c1730f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:20.176383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:20.268258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf5b93-1c1c-4719-8f0b-fadef8c1730f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:20.301553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:20.302346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.302633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.302911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.313578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:26:20.321259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:20.322362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:20.323653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 639/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:20.328624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:20.346346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:20.425941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b44a-bde2-47ce-a293-7ad90396b5e8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:20.458739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:20.459445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.459755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.460053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.460799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:20.461107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:20.462561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:20.472023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 625/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:20.477822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:20.558653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:20.592062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0a0d-6f20-4278-a506-b8006cfd938b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:20.625272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:20.626063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.626346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.626623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.637303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:20.638745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:20.655919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:20.656951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:20.658046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:20.658046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:20.658046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:20.658046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:20.658046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 640/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:20.663107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:20.744036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:20.769770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23888b-b86e-47af-aecb-6b914f4517f7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:20.809280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:20.809958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.810249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.810530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.811437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:20.811781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:20.813150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:20.828834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 626/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:20.834744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:20.937362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684d34f-ec44-4749-923f-48b853466405 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:20.959001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:20.973821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:20.974628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:20.974910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:20.975189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:20.982951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:20.984438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:26:20.998617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:20.999780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:21.000790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 641/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:21.005636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:21.103499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892cf47-333b-4814-bf93-9dd5bc64516c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:21.138187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:21.138874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:21.139381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:21.139921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:21.140920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:21.141257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:21.142731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:21.154017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:21.162887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 627/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 20 09:26:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:21.168718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:21.275445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62224f-1b92-472a-b07b-8694fbec1d83 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:21.308299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:21.309091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:21.309379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:21.309659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:21.320034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:21.321489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:21.339148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:21.340220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:21.341431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:21.341431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:21.341431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:21.341431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:21.341431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 642/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:21.346133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:21.443440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2502824-2556-4029-8f14-06c8cab2e528 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:21.481953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:21.482753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:21.483053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:21.483336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:21.484192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:21.484504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:21.486059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:21.501712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 628/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:21.508190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:21.540156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:21.606777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10246-b1e4-4c54-a640-95a1d35e31a9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:21.640673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:21.641480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:21.641760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:21.642032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:21.649061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:21.651144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:26:21.665105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:21.666217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:21.667394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 643/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 09:26:21.672183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:21.728122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:21.773652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e79bb-9339-472c-a52f-0600a04985ad None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:21.809973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:21.810568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:21.810853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:21.811131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:21.811974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:21.812366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:21.813721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ab09-d99a-46e8-b49f-c0957a7c965c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:21.826337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 629/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:21.832371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:21.922456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:21.931323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c02c7-6449-4913-b9e9-f7b7069463ad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:21.965963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3ee3-fe5a-490c-8898-8f493868e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:21.966849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3ee3-fe5a-490c-8898-8f493868e487 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:21.967131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3ee3-fe5a-490c-8898-8f493868e487 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:21.967408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3ee3-fe5a-490c-8898-8f493868e487 None admin] PATH_INFO: `/v3/projects/ffec6317780a4fdeb84706157bed3829/users/4ad02dfcd1184ef690f171ac4410381f/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:21.969372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3ee3-fe5a-490c-8898-8f493868e487 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffec6317780a4fdeb84706157bed3829, user_id=4ad02dfcd1184ef690f171ac4410381f, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:21.970802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3ee3-fe5a-490c-8898-8f493868e487 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:21.983707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 644/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 20 09:26:21 2022] PUT /identity/v3/projects/ffec6317780a4fdeb84706157bed3829/users/4ad02dfcd1184ef690f171ac4410381f/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:26:24.189150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384f14-3522-4760-be12-3a1c7a082a0b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:24.189665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384f14-3522-4760-be12-3a1c7a082a0b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:24.189665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384f14-3522-4760-be12-3a1c7a082a0b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:24.190959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 630/1274] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:24.196048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:24.196435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:24.196619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:24.213658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:24.214854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:24.279988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 645/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:24.303442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd384f14-3522-4760-be12-3a1c7a082a0b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:24.405741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd384f14-3522-4760-be12-3a1c7a082a0b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:24.422243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:24.439542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:24.440309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:24.440596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:24.440872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:24.451260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 09:26:24.460116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:24.461075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:24.462319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 631/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 20 09:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:24.469864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:24.558586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:24.578030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f2a2-3d8a-41e5-8336-ff95db111220 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:24.617494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:24.618171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:24.618456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:24.618733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:24.620381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:24.620696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:24.622620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:24.630705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 646/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 20 09:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:24.637078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:24.746836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5db5cb-019f-4016-9fa0-76732494e111 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:24.781076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:24.781864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:24.782143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:24.782417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:24.793332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:24.794765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:24.812040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:24.813146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:24.814422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:24.814422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:24.814422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:24.814422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:24.814422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 632/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:24.819022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:24.921074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3359b-eddc-4bb5-82fe-7a452aa3f767 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:24.954159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:24.954840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:24.955126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:24.955405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:24.956188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:24.956500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:24.957880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:24.970635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 647/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:24.976379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:25.007169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:25.077432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cd8b3-1fd3-4744-960f-80ccd6df9232 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:25.110099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:25.111467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:25.111467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:25.111467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:25.120928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:25.122524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 09:26:25.137560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:25.138678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:25.140084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 633/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:25.144595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:25.148361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:25.246998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2d9b3-b0ca-453a-92c5-e6e1eab68932 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:25.281794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:25.282379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:25.282649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:25.282923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:25.283788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:25.284095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:25.285538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:25.304698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 648/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 20 09:26:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:25.311164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:25.399608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:25.409021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5d631-64da-49e0-ad5b-2ddfb52f4e2c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:25.444507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:25.445150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:25.445436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:25.445708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:25.517028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:25.518473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:25.604685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:25.615230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 634/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 20 09:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 09:26:25.621615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:25.682646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:25.721860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f64e-2166-40b5-aaab-42628380b0d7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:25.755841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:25.756639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:25.756920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:25.757194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:25.767888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:25.769337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 09:26:25.787347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:25.788499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:25.789449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 09:26:25.789449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 09:26:25.789449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 09:26:25.789449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:25.789449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 649/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:25.794538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:25.897954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdccd45-8d30-4bd3-b750-467388bab2bb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:25.930278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:25.930939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:25.931219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:25.932240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:25.932965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:25.933268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:25.934628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:25.946684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 635/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 20 09:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:25.953354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:26.053793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66520-c08e-478f-864e-9ce150c2c791 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:26.069095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:26.090406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:26.091200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:26.091483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:26.091781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:26.098362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:26.099827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 09:26:26.113805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:26.114882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 20 09:26:26.115876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 650/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 20 09:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:26.121224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:26.170823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:26.219553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdffd0-f3e6-46e3-9526-8e07d65ef0df None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:26.252029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:26.252677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:26.252959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:26.253233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:26.254007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:26.254315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:26.255753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bf3e4-d391-4ee3-866c-6208c20512b8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:26.268352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 636/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 20 09:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:26.274455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:26.393850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd35a2-2760-4621-9b6e-a6ed4fae932d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:26.429980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:26.430567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:26.430850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:26.431127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:26.432045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] RBAC: Adding query filter params (role.id=2e997984fe364ad8afd717716e701a23, scope.project.id=ffec6317780a4fdeb84706157bed3829, user.id=4ad02dfcd1184ef690f171ac4410381f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:26.432359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:26.433796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ad89d-cee8-40ab-a68a-fa690235f4ef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:26.439640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 651/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 20 09:26:26 2022] GET /identity/v3/role_assignments?user.id=4ad02dfcd1184ef690f171ac4410381f&scope.project.id=ffec6317780a4fdeb84706157bed3829&role.id=2e997984fe364ad8afd717716e701a23 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:28.490130 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4344-fdfe-4be6-b3e6-19cc1410361b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:28.490770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4344-fdfe-4be6-b3e6-19cc1410361b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:28.490770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4344-fdfe-4be6-b3e6-19cc1410361b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:28.492132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 637/1288] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:26:28.498742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:28.499257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:28.499564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:28.520156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:28.521852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:28.555230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:28.592939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 652/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:28.615870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4344-fdfe-4be6-b3e6-19cc1410361b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:28.715729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4344-fdfe-4be6-b3e6-19cc1410361b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:28.726689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:28.750206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:28.750933 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:28.751211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:28.751513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:28.752160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:28.753510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:28.765872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:28.767132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:28.768042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 638/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:26:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:28.773174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:28.872598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599aa4-51af-4e19-bf9e-4507834b8812 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:28.906941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:28.907613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:28.907926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:28.908207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:28.908913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:28.909223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:28.910593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33efcf-103e-4cc9-8614-beea2a701357 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:28.915368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 653/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 20 09:26:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:28.921835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:29.019969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff027866-36ec-4b69-bd90-dda5232be10a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:29.052867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:29.053556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:29.053833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:29.054103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:29.054801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:29.055105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:29.057133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de891887-f215-4eeb-9634-99e2fc38a601 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:29.061438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 639/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 20 09:26:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:31.251398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47fc1-ea83-4140-b3e9-e30d2e0febaf None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:31.251965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47fc1-ea83-4140-b3e9-e30d2e0febaf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:31.251965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47fc1-ea83-4140-b3e9-e30d2e0febaf None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:31.253486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 654/1293] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:31.259155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeb863-4efc-4d01-83aa-ffed677c6ff6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:31.259607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeb863-4efc-4d01-83aa-ffed677c6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:31.259739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeb863-4efc-4d01-83aa-ffed677c6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:31.276887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2dbeb863-4efc-4d01-83aa-ffed677c6ff6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:31.278077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2dbeb863-4efc-4d01-83aa-ffed677c6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:31.307452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:31.344627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 640/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:31.368113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47fc1-ea83-4140-b3e9-e30d2e0febaf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:31.399385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:31.470944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47fc1-ea83-4140-b3e9-e30d2e0febaf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:31.518093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552c38-041d-484a-b82c-1fd3879cfbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:31.518880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552c38-041d-484a-b82c-1fd3879cfbd3 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:31.519293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552c38-041d-484a-b82c-1fd3879cfbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:31.519773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552c38-041d-484a-b82c-1fd3879cfbd3 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:31.520792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552c38-041d-484a-b82c-1fd3879cfbd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:31.522720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552c38-041d-484a-b82c-1fd3879cfbd3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:31.541021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 655/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 20 09:26:31 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:26:33.749009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b711d-e68d-4ff0-bd1f-0c306219b078 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:33.749655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b711d-e68d-4ff0-bd1f-0c306219b078 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:33.749655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b711d-e68d-4ff0-bd1f-0c306219b078 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:33.750944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 641/1296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:33.756598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:33.757059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:33.757177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:33.776173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:33.777377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:33.853693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 656/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:33.876319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b711d-e68d-4ff0-bd1f-0c306219b078 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:33.980200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b711d-e68d-4ff0-bd1f-0c306219b078 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:34.013686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:34.014416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:34.014700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:34.014975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] PATH_INFO: `/v3/services/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:34.015628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:34.017011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:34.028708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:34.029853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:34.030895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 642/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:26:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:34.035981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:34.053944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:34.137547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21750-9d5c-45a3-a42a-6a0e51b8b895 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:34.171948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:34.172610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:34.172888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:34.173159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:34.173866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:34.174172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:34.175544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:34.180873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 657/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 20 09:26:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:34.186840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:34.217368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:34.284244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34bab2-7da4-489a-b6a1-f47461d942db None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:34.316057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:34.316695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:34.316974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:34.317248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:34.318026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] RBAC: Adding query filter params (interface=public, service_id=dab597b219d743638cbf8f4a5e631dda, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:34.318337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:34.319685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e969c-03ae-4c81-a659-d13ad3981df0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:34.325076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 643/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 20 09:26:34 2022] GET /identity/v3/endpoints?service_id=dab597b219d743638cbf8f4a5e631dda&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:34.330624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:34.410306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:34.428301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441001e0-aa95-4375-888e-9457b96f925a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:34.464038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77325e7-7088-4212-9853-8bdd1ba018c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:34.464862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77325e7-7088-4212-9853-8bdd1ba018c4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:34.465221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77325e7-7088-4212-9853-8bdd1ba018c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:34.465507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77325e7-7088-4212-9853-8bdd1ba018c4 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:34.466419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77325e7-7088-4212-9853-8bdd1ba018c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:34.468356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77325e7-7088-4212-9853-8bdd1ba018c4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:34.476776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 658/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 20 09:26:34 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:26:36.506012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da1afc-a235-4636-8741-7b02d1aa7162 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:36.506573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da1afc-a235-4636-8741-7b02d1aa7162 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:36.506573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da1afc-a235-4636-8741-7b02d1aa7162 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:36.507960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 644/1302] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:26:36.514255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:36.514681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:36.514815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:36.531333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:26:36.532551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:26:36.597096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 659/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:26:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 09:26:36.620676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da1afc-a235-4636-8741-7b02d1aa7162 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:36.710755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:36.717656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da1afc-a235-4636-8741-7b02d1aa7162 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:36.752188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:36.753163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:36.753444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:36.753715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:36.754371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:36.755755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 09:26:36.769431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 09:26:36.770610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Jul 20 09:26:36.771806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 645/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 20 09:26:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 09:26:36.777189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:36.855133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:36.877962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9138-7cb8-4607-92a5-0a882d3e82a2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:36.913612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:36.914276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:36.914559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:36.914835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:36.915625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:26:36.915962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:36.917329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee8c59-e430-43f3-ae94-85a53cdac596 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:36.922402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 660/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 20 09:26:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:26:36.928245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:26:37.026220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41977bc6-fc11-456f-b026-9d559e177946 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:26:37.058743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2971ce-2445-4a09-b4b5-ddfa7b7948db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:26:37.059399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2971ce-2445-4a09-b4b5-ddfa7b7948db None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:26:37.059683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2971ce-2445-4a09-b4b5-ddfa7b7948db None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:26:37.059991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2971ce-2445-4a09-b4b5-ddfa7b7948db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:26:37.060727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2971ce-2445-4a09-b4b5-ddfa7b7948db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:26:37.062085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2971ce-2445-4a09-b4b5-ddfa7b7948db None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:26:37.079678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 646/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 20 09:26:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:26:46.919402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=30 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:26:47.075351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:40.555846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931f792-cfe8-4d10-be88-055d452d9299 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:40.556402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931f792-cfe8-4d10-be88-055d452d9299 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:40.556626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931f792-cfe8-4d10-be88-055d452d9299 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:40.562049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 661/1307] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:40.563435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640abc-a1c5-40da-af77-5695ee2a9d6f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:40.563937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640abc-a1c5-40da-af77-5695ee2a9d6f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:40.564022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640abc-a1c5-40da-af77-5695ee2a9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:40.655470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3b640abc-a1c5-40da-af77-5695ee2a9d6f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:40.657285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3b640abc-a1c5-40da-af77-5695ee2a9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:40.821281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 647/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:40.873463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8399c-6d66-471c-9f5d-bd156a55a1ae None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:40.874069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8399c-6d66-471c-9f5d-bd156a55a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:40.874513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8399c-6d66-471c-9f5d-bd156a55a1ae None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:40.876425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 662/1309] 10.222.0.20 () {54 vars in 965 bytes} [Wed Jul 20 09:27:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:40.885760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e002-67b6-462c-a932-402459d6df98 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:40.886166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e002-67b6-462c-a932-402459d6df98 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:40.886553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8e002-67b6-462c-a932-402459d6df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:40.997701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-70a8e002-67b6-462c-a932-402459d6df98 None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:40.998957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-70a8e002-67b6-462c-a932-402459d6df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:41.022736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:41.106838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 648/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Jul 20 09:27:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:41.115960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8399c-6d66-471c-9f5d-bd156a55a1ae None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:41.117882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f7c8399c-6d66-471c-9f5d-bd156a55a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:41.231872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8399c-6d66-471c-9f5d-bd156a55a1ae None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:41.315347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:41.316130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:41.316480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:41.316824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:41.319080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:41.377613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:41.460221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:41.461770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c223c5-5f9a-45bd-a5cf-5d2d2e60d87e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:41.484263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 663/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:27:43.856480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fcec1-49fc-4994-b11d-c16042f2c8fb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:43.857137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fcec1-49fc-4994-b11d-c16042f2c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:43.857137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fcec1-49fc-4994-b11d-c16042f2c8fb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:43.858522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 649/1312] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:43.863567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b3eb-0c4c-4295-9fe3-fc34cc23b382 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:43.864095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b3eb-0c4c-4295-9fe3-fc34cc23b382 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:43.864187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b3eb-0c4c-4295-9fe3-fc34cc23b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:43.943767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7524b3eb-0c4c-4295-9fe3-fc34cc23b382 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:43.945012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7524b3eb-0c4c-4295-9fe3-fc34cc23b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:44.062146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 664/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:27:44.101557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fcec1-49fc-4994-b11d-c16042f2c8fb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:44.103098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b76fcec1-49fc-4994-b11d-c16042f2c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:44.239123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fcec1-49fc-4994-b11d-c16042f2c8fb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:44.319450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:44.322456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:44.323132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:44.323666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:44.323989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:44.326183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:44.438470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:44.439928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017c3d1-4bc1-4917-98b3-7c3387c5cc54 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:44.474611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 650/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:27:46.819234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a342a-f04f-4ac6-baa7-a7f2134d1b26 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:46.819813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a342a-f04f-4ac6-baa7-a7f2134d1b26 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:46.819813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a342a-f04f-4ac6-baa7-a7f2134d1b26 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:46.821221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 665/1315] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:46.826490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af80b-eedc-49b1-a8c6-c002d463e318 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:46.826918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af80b-eedc-49b1-a8c6-c002d463e318 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:46.827028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af80b-eedc-49b1-a8c6-c002d463e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:46.890971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f84af80b-eedc-49b1-a8c6-c002d463e318 None None] MFA Rules not processed for user `4be60a1b42104c2fb599167b6e30dc37`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:46.892237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f84af80b-eedc-49b1-a8c6-c002d463e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:46.943891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:46.987212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 651/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:47.044011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d640-cad3-4528-9a67-8ba903a6de5e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:47.044299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d640-cad3-4528-9a67-8ba903a6de5e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:47.044577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d640-cad3-4528-9a67-8ba903a6de5e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:47.045958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 666/1317] 10.222.0.20 () {54 vars in 965 bytes} [Wed Jul 20 09:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:47.051709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b212a2a-7172-41dc-8fdc-51ae571929f9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:47.052664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b212a2a-7172-41dc-8fdc-51ae571929f9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:47.052965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b212a2a-7172-41dc-8fdc-51ae571929f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:47.127150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4b212a2a-7172-41dc-8fdc-51ae571929f9 None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:47.128387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b212a2a-7172-41dc-8fdc-51ae571929f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:47.203248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 652/1318] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Jul 20 09:27:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:47.212335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1d640-cad3-4528-9a67-8ba903a6de5e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:47.213870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0cc1d640-cad3-4528-9a67-8ba903a6de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:47.223548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:47.317675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1d640-cad3-4528-9a67-8ba903a6de5e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:47.389675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:47.390251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:47.390535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:47.390811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:47.392482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:47.453732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:47.502091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:47.503527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09585a4d-d325-415e-b63c-76a6d7b94329 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:47.523992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 667/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:27:50.524342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95125b05-257a-4f70-a52e-fdb9e7e8adc6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:50.524929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95125b05-257a-4f70-a52e-fdb9e7e8adc6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:50.525046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95125b05-257a-4f70-a52e-fdb9e7e8adc6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:50.526411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 653/1320] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:50.531624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7e0a6-b350-4a71-8565-2951ddcf2d22 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:50.532094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7e0a6-b350-4a71-8565-2951ddcf2d22 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:50.532197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7e0a6-b350-4a71-8565-2951ddcf2d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:50.597692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bdf7e0a6-b350-4a71-8565-2951ddcf2d22 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:50.598818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bdf7e0a6-b350-4a71-8565-2951ddcf2d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:50.695256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 668/1321] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:50.733909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95125b05-257a-4f70-a52e-fdb9e7e8adc6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:50.735439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-95125b05-257a-4f70-a52e-fdb9e7e8adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:50.785465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:50.839375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95125b05-257a-4f70-a52e-fdb9e7e8adc6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:50.911681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:50.912306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:50.912593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:50.912863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:50.914508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:51.009040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:51.024056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:51.025745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b597e0-4af1-4031-9a87-70de317d605b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:51.044177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 654/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:27:53.771098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08891df-69be-4d89-8114-945eb4fd4e10 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:53.771687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08891df-69be-4d89-8114-945eb4fd4e10 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:53.771687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08891df-69be-4d89-8114-945eb4fd4e10 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:53.773174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 669/1323] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:53.778521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7407fc0-7ce5-4565-baaf-855a0f0a1db5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:53.778961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7407fc0-7ce5-4565-baaf-855a0f0a1db5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:53.779070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7407fc0-7ce5-4565-baaf-855a0f0a1db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:53.850383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f7407fc0-7ce5-4565-baaf-855a0f0a1db5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:53.851600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f7407fc0-7ce5-4565-baaf-855a0f0a1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:53.958820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 655/1324] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:53.996957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08891df-69be-4d89-8114-945eb4fd4e10 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:53.998525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b08891df-69be-4d89-8114-945eb4fd4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:54.019883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:54.111887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08891df-69be-4d89-8114-945eb4fd4e10 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:54.187878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:54.188540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:54.188823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:54.189099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:54.190797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:54.275092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:54.313815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:54.315165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248599c4-4b6c-4184-a2a1-e44486c1a1b6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:54.334084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 670/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:27:56.451414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572d2dc-faf1-4fbb-8aff-01faffec6f05 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:56.451956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572d2dc-faf1-4fbb-8aff-01faffec6f05 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:56.451956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572d2dc-faf1-4fbb-8aff-01faffec6f05 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:56.453250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 656/1326] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:56.458920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e862f-0955-4e16-9b47-3e6abca7f5f8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:56.459380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e862f-0955-4e16-9b47-3e6abca7f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:56.459492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e862f-0955-4e16-9b47-3e6abca7f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:56.527524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-829e862f-0955-4e16-9b47-3e6abca7f5f8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:56.528816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-829e862f-0955-4e16-9b47-3e6abca7f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:56.630647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 671/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:56.669544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572d2dc-faf1-4fbb-8aff-01faffec6f05 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:56.671090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4572d2dc-faf1-4fbb-8aff-01faffec6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:56.732035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:56.776679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572d2dc-faf1-4fbb-8aff-01faffec6f05 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:56.862516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:56.863196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:56.863481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:56.863782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:56.865449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:56.977208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:56.980410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:56.982250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b1072-f608-442e-b1ca-bc002479c6bc service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:57.003589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 657/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:27:59.130382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0345a-1b68-41b4-b297-46420e8c69dc None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:59.130927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0345a-1b68-41b4-b297-46420e8c69dc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:59.130927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0345a-1b68-41b4-b297-46420e8c69dc None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:59.132312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 672/1329] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:27:59.138055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4d03b-f299-46b9-99c3-8f04f656fa43 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:59.138551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4d03b-f299-46b9-99c3-8f04f656fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:59.138752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4d03b-f299-46b9-99c3-8f04f656fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:59.210275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c5e4d03b-f299-46b9-99c3-8f04f656fa43 None None] MFA Rules not processed for user `4be60a1b42104c2fb599167b6e30dc37`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:27:59.211506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c5e4d03b-f299-46b9-99c3-8f04f656fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:59.331781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 658/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:27:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:27:59.370061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0345a-1b68-41b4-b297-46420e8c69dc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:27:59.371599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cfa0345a-1b68-41b4-b297-46420e8c69dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:59.403343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:59.480989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0345a-1b68-41b4-b297-46420e8c69dc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:27:59.556456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:27:59.557106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:27:59.557388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:27:59.557659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:27:59.559304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:27:59.646367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:59.693218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:27:59.694707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919538e1-f28e-4662-a492-e6b9344a24af service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:27:59.715382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 673/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:27:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:02.125446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374415-575b-453b-8805-120a7bcf0735 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:02.125998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374415-575b-453b-8805-120a7bcf0735 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:02.125998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374415-575b-453b-8805-120a7bcf0735 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:02.127366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 659/1332] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:02.133096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999ff7-26d8-4641-b818-02586356afa7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:02.133526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999ff7-26d8-4641-b818-02586356afa7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:02.133654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999ff7-26d8-4641-b818-02586356afa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:02.198371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7a999ff7-26d8-4641-b818-02586356afa7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:02.199600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a999ff7-26d8-4641-b818-02586356afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:02.297631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 674/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:02.334144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c374415-575b-453b-8805-120a7bcf0735 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:02.335746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5c374415-575b-453b-8805-120a7bcf0735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:02.408119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:02.445278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c374415-575b-453b-8805-120a7bcf0735 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:02.521802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:02.522457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:02.522814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:02.523077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:02.524797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:02.634224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:02.635957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039d2ab-b974-4efb-aeb0-e7e60aa5936b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:02.645770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:02.655122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 660/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:04.714206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35d0a-fc75-4a4c-8c84-992b3d397d25 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:04.714785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35d0a-fc75-4a4c-8c84-992b3d397d25 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:04.714785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab35d0a-fc75-4a4c-8c84-992b3d397d25 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:04.716203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 675/1335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:04.721478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409fe04-c019-4d6e-a788-12feac590540 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:04.721900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409fe04-c019-4d6e-a788-12feac590540 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:04.722012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409fe04-c019-4d6e-a788-12feac590540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:04.788266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e409fe04-c019-4d6e-a788-12feac590540 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:04.789475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e409fe04-c019-4d6e-a788-12feac590540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:04.887803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 661/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:04.927671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab35d0a-fc75-4a4c-8c84-992b3d397d25 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:04.929269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5ab35d0a-fc75-4a4c-8c84-992b3d397d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:04.968741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:05.032775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab35d0a-fc75-4a4c-8c84-992b3d397d25 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:05.106644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:05.107288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:05.107569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:05.107874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:05.109539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:05.194154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:05.220025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:05.221436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336969-4e21-4655-9b80-e65bbbc186b4 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:05.240212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 676/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:07.831500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496093cc-188a-48b7-9f52-6d2a035802f6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:07.831979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496093cc-188a-48b7-9f52-6d2a035802f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:07.832131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496093cc-188a-48b7-9f52-6d2a035802f6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:07.833464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 662/1338] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:07.838779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138dc7e-c360-411d-89a2-5b9226a230d5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:07.839191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138dc7e-c360-411d-89a2-5b9226a230d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:07.839344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138dc7e-c360-411d-89a2-5b9226a230d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:07.904760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2138dc7e-c360-411d-89a2-5b9226a230d5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:07.906006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2138dc7e-c360-411d-89a2-5b9226a230d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:08.001980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 677/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:08.039542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496093cc-188a-48b7-9f52-6d2a035802f6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:08.041115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-496093cc-188a-48b7-9f52-6d2a035802f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:08.117442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:08.145620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496093cc-188a-48b7-9f52-6d2a035802f6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:08.218750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:08.219402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:08.219687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:08.220001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:08.221654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:08.329171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:08.330595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248a7c9-d64c-44d7-9fdb-167ddaf85c72 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:08.349197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 663/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:12.480927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a520e-3ec0-465c-bfcb-d1909081956d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:12.481471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a520e-3ec0-465c-bfcb-d1909081956d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:12.481471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a520e-3ec0-465c-bfcb-d1909081956d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:12.482868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 678/1341] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:12.488082 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ec1c8-412c-4f06-bc4d-19999875ee64 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:12.489018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ec1c8-412c-4f06-bc4d-19999875ee64 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:12.489167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ec1c8-412c-4f06-bc4d-19999875ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:12.493359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:12.557510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8b8ec1c8-412c-4f06-bc4d-19999875ee64 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:12.558727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8b8ec1c8-412c-4f06-bc4d-19999875ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:12.658869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 664/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:12.698819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a520e-3ec0-465c-bfcb-d1909081956d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:12.700506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1a9a520e-3ec0-465c-bfcb-d1909081956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:12.754161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:12.823892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a520e-3ec0-465c-bfcb-d1909081956d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:12.907837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:12.909285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:12.909571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:12.909849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:12.911518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:13.009860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:13.027934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:13.029378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e577e2-f07f-411a-b207-2bac9b29c43e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:13.048034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 679/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:15.749417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b095d56-c67f-4644-b4cb-e4751365bf53 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:15.749976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b095d56-c67f-4644-b4cb-e4751365bf53 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:15.749976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b095d56-c67f-4644-b4cb-e4751365bf53 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:15.751366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 665/1344] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:15.757605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf07f4-4ee7-46fc-a931-4990951cfe1f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:15.758146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf07f4-4ee7-46fc-a931-4990951cfe1f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:15.758146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf07f4-4ee7-46fc-a931-4990951cfe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:15.832576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-25cf07f4-4ee7-46fc-a931-4990951cfe1f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:15.833792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-25cf07f4-4ee7-46fc-a931-4990951cfe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:15.934165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 680/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:15.973336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b095d56-c67f-4644-b4cb-e4751365bf53 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:15.975001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8b095d56-c67f-4644-b4cb-e4751365bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:16.072142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:16.090379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b095d56-c67f-4644-b4cb-e4751365bf53 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:16.167184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:16.167870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:16.168245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:16.168467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:16.170157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:16.281316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:16.282758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1259b3-1200-4e52-972f-0d6f29b49eb8 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:16.302320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 666/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:20.555531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db184f9-5880-4f29-9499-1cc4c730a3aa None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:20.556173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db184f9-5880-4f29-9499-1cc4c730a3aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:20.556173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db184f9-5880-4f29-9499-1cc4c730a3aa None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:20.557703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 681/1347] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:20.563052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb71f-54b4-4446-be36-36dcb9b2cb20 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:20.563556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb71f-54b4-4446-be36-36dcb9b2cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:20.563654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb71f-54b4-4446-be36-36dcb9b2cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:20.578375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:20.638589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-111cb71f-54b4-4446-be36-36dcb9b2cb20 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:20.639780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-111cb71f-54b4-4446-be36-36dcb9b2cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:20.749256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 667/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:20.788958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db184f9-5880-4f29-9499-1cc4c730a3aa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:20.790516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8db184f9-5880-4f29-9499-1cc4c730a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:20.853922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:20.906698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db184f9-5880-4f29-9499-1cc4c730a3aa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:20.984485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:20.985142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:20.985421 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:20.985691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:20.987370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:21.116361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:21.120348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:21.121947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da2a81-e460-4fce-aec6-da077bde64ce service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:21.140241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 682/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:26.086648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a65f39-6ee3-48ce-9e23-36df9f3f7c7a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:26.087166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a65f39-6ee3-48ce-9e23-36df9f3f7c7a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:26.087261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a65f39-6ee3-48ce-9e23-36df9f3f7c7a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:26.089457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 668/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:26.094788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ff844-0868-4102-bce2-8b27212bfc8a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:26.095218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ff844-0868-4102-bce2-8b27212bfc8a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:26.095516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ff844-0868-4102-bce2-8b27212bfc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:26.228007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a91ff844-0868-4102-bce2-8b27212bfc8a None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:26.229589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a91ff844-0868-4102-bce2-8b27212bfc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:26.351785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 683/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:28:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:30.747302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=59 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:31.137901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4310bf-fe81-457a-871f-be9641901144 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:31.138498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4310bf-fe81-457a-871f-be9641901144 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:31.138777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4310bf-fe81-457a-871f-be9641901144 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:31.140669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 669/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:31.145967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368814e-d0be-47ca-899f-bc070b56d9c6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:31.146414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368814e-d0be-47ca-899f-bc070b56d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:31.147173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368814e-d0be-47ca-899f-bc070b56d9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:31.211378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:31.242242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d368814e-d0be-47ca-899f-bc070b56d9c6 None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:31.243627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d368814e-d0be-47ca-899f-bc070b56d9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:31.363820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 684/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:28:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:32.545818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f216-e5d4-4d5e-b28c-f1617917c56a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:32.546349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f216-e5d4-4d5e-b28c-f1617917c56a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:32.546349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f216-e5d4-4d5e-b28c-f1617917c56a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:32.547940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 670/1354] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:32.554461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa55895-cad9-4d2a-99b9-794222ddf2c3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:32.555282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa55895-cad9-4d2a-99b9-794222ddf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:32.555571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa55895-cad9-4d2a-99b9-794222ddf2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:32.634271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2aa55895-cad9-4d2a-99b9-794222ddf2c3 None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:32.635400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2aa55895-cad9-4d2a-99b9-794222ddf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:32.678215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:32.757487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 685/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:36.094398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d2ff-b94a-4de4-8687-47aecb9098c8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:36.095238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d2ff-b94a-4de4-8687-47aecb9098c8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:36.095781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d2ff-b94a-4de4-8687-47aecb9098c8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:36.101737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 671/1356] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:36.103923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfaf5d-23cd-4a09-a34a-60967735d5b1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:36.104761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfaf5d-23cd-4a09-a34a-60967735d5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:36.106128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfaf5d-23cd-4a09-a34a-60967735d5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:36.192144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e5bfaf5d-23cd-4a09-a34a-60967735d5b1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:36.193741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e5bfaf5d-23cd-4a09-a34a-60967735d5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:36.308384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 686/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:36.359283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d137-02fd-422e-9643-aa91dfdbb8ad None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:36.359939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d137-02fd-422e-9643-aa91dfdbb8ad None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:36.360450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d137-02fd-422e-9643-aa91dfdbb8ad None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:36.363058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 672/1358] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 20 09:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:36.375416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df81136-46a0-490d-b098-b233abb1d773 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:36.376095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df81136-46a0-490d-b098-b233abb1d773 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:36.376632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df81136-46a0-490d-b098-b233abb1d773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:36.397375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:36.462967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9df81136-46a0-490d-b098-b233abb1d773 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:36.464206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9df81136-46a0-490d-b098-b233abb1d773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:36.589859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 687/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 20 09:28:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:36.597679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d137-02fd-422e-9643-aa91dfdbb8ad None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:36.599258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0348d137-02fd-422e-9643-aa91dfdbb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:36.752012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d137-02fd-422e-9643-aa91dfdbb8ad None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:36.831916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:36.884986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:36.886308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:36.886949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:36.887528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:36.890059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:36.994026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:36.995635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262b0aa-f396-4e82-aeb5-e7cd0e1be054 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:37.016781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 673/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:39.294354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9594-28f6-4972-bfc1-37e3099dbf69 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:39.294773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9594-28f6-4972-bfc1-37e3099dbf69 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:39.294960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf9594-28f6-4972-bfc1-37e3099dbf69 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:39.297132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 688/1361] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:39.302994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb79d-a3fa-4309-98ae-030c8a9ce061 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:39.303449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb79d-a3fa-4309-98ae-030c8a9ce061 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:39.303543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb79d-a3fa-4309-98ae-030c8a9ce061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:39.373706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fcfdb79d-a3fa-4309-98ae-030c8a9ce061 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:39.374889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fcfdb79d-a3fa-4309-98ae-030c8a9ce061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:39.414527 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:39.483031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 674/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:39.537419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf9594-28f6-4972-bfc1-37e3099dbf69 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:39.540035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f3cf9594-28f6-4972-bfc1-37e3099dbf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:39.647377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:39.757278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf9594-28f6-4972-bfc1-37e3099dbf69 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:39.917175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:39.918193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:39.918581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:39.918957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:39.920786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:39.945780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:40.022489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:40.024142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90139bf0-6e4b-446a-9e6d-798374005c79 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:40.044067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 689/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:42.482137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1760f3b-5ad0-467d-a98f-f3534440f77d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:42.482714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1760f3b-5ad0-467d-a98f-f3534440f77d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:42.483064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1760f3b-5ad0-467d-a98f-f3534440f77d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:42.484416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 675/1364] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:42.490476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8face47-0ccd-43c2-8a67-c8c94c1a07e6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:42.490945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8face47-0ccd-43c2-8a67-c8c94c1a07e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:42.491024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8face47-0ccd-43c2-8a67-c8c94c1a07e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:42.577964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b8face47-0ccd-43c2-8a67-c8c94c1a07e6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:42.579289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b8face47-0ccd-43c2-8a67-c8c94c1a07e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:42.704118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:42.715840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 690/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:42.756817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2cad-d9f3-4649-9000-5bee3d9f3a49 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:42.757185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2cad-d9f3-4649-9000-5bee3d9f3a49 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:42.757537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2cad-d9f3-4649-9000-5bee3d9f3a49 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:42.759484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 676/1366] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 20 09:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:42.766151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bc1e5-97ea-4224-ad2b-57f51c33a85d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:42.766447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bc1e5-97ea-4224-ad2b-57f51c33a85d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:42.766722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bc1e5-97ea-4224-ad2b-57f51c33a85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:42.857392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7d9bc1e5-97ea-4224-ad2b-57f51c33a85d None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:42.858717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d9bc1e5-97ea-4224-ad2b-57f51c33a85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:43.003753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 691/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 20 09:28:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:43.009341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2cad-d9f3-4649-9000-5bee3d9f3a49 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:43.010876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f2ff2cad-d9f3-4649-9000-5bee3d9f3a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:43.198923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2cad-d9f3-4649-9000-5bee3d9f3a49 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:43.220309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:43.320196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:43.320662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:43.320947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:43.321230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:43.322891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:43.418033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:43.419646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b534ac-df49-4a10-9c35-5284bb2df3a1 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:43.443774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 677/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:44.409238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c025dce-f7b1-4927-a49b-9579575ecfdb None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:44.409756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c025dce-f7b1-4927-a49b-9579575ecfdb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:44.409836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c025dce-f7b1-4927-a49b-9579575ecfdb None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:44.411435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 692/1369] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:44.416964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c944b-b84a-4698-b370-8a7eaf0e6df7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:44.417368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c944b-b84a-4698-b370-8a7eaf0e6df7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:44.417584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c944b-b84a-4698-b370-8a7eaf0e6df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:44.450137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:44.492738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f96c944b-b84a-4698-b370-8a7eaf0e6df7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:44.493962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f96c944b-b84a-4698-b370-8a7eaf0e6df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:44.606289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 678/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:44.956420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49e3b-8369-43b7-8f0e-9b03ed3ab168 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:44.956420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49e3b-8369-43b7-8f0e-9b03ed3ab168 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:44.956946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49e3b-8369-43b7-8f0e-9b03ed3ab168 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:44.958042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 693/1371] 10.222.0.20 () {54 vars in 964 bytes} [Wed Jul 20 09:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:44.964289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400caa-ef78-42db-87f4-2c85352137a3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:44.964289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400caa-ef78-42db-87f4-2c85352137a3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:44.964289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400caa-ef78-42db-87f4-2c85352137a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:45.046581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bc400caa-ef78-42db-87f4-2c85352137a3 None None] MFA Rules not processed for user `92f96e51cfa14f148a5dd3ebd18f591c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:45.047914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc400caa-ef78-42db-87f4-2c85352137a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:45.099903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:45.134912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 679/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Jul 20 09:28:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:45.143158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af49e3b-8369-43b7-8f0e-9b03ed3ab168 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:45.144737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1af49e3b-8369-43b7-8f0e-9b03ed3ab168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:45.214223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:45.273176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af49e3b-8369-43b7-8f0e-9b03ed3ab168 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:45.353180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:45.353751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:45.354040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:45.354316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:45.356043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:45.484548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:45.502841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:45.504379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa97d7-6b07-43d2-a1c2-bb786846b0c2 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:45.524608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 694/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:45.563361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356ad5-5973-441d-b125-5b13cca7797f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:45.563818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356ad5-5973-441d-b125-5b13cca7797f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:45.564044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356ad5-5973-441d-b125-5b13cca7797f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:45.565671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 680/1374] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:45.570844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0d171-e53e-46bf-87c5-0ff0504bfcc2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:45.571153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0d171-e53e-46bf-87c5-0ff0504bfcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:45.571416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0d171-e53e-46bf-87c5-0ff0504bfcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:45.642214 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6cf0d171-e53e-46bf-87c5-0ff0504bfcc2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:45.644179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6cf0d171-e53e-46bf-87c5-0ff0504bfcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:45.756273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 695/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:45.796992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356ad5-5973-441d-b125-5b13cca7797f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:45.798604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4a356ad5-5973-441d-b125-5b13cca7797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:45.974934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356ad5-5973-441d-b125-5b13cca7797f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:46.027124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:46.088570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:46.089217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:46.089497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:46.089768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:46.091392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:46.193048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:46.194663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7545b4-6b7a-4cdc-b5a7-c7a832f6678b service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:46.214541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 681/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:48.292375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc5c7-94ad-40af-9822-6932f8c81870 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:48.292896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc5c7-94ad-40af-9822-6932f8c81870 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:48.292896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc5c7-94ad-40af-9822-6932f8c81870 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:48.294295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 696/1377] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:48.300230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46028550-8aa0-4557-b708-0bb50fbb85e3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:48.300626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46028550-8aa0-4557-b708-0bb50fbb85e3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:48.300787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46028550-8aa0-4557-b708-0bb50fbb85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:48.366773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-46028550-8aa0-4557-b708-0bb50fbb85e3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:48.368007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-46028550-8aa0-4557-b708-0bb50fbb85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:48.374773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:48.475734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 682/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:48.523547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc5c7-94ad-40af-9822-6932f8c81870 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:48.525170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a74bc5c7-94ad-40af-9822-6932f8c81870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:48.611915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:48.700800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc5c7-94ad-40af-9822-6932f8c81870 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:48.821022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:48.821603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:48.821887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:48.822167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:48.823887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:48.850270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:48.920966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:48.922564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f2eed-d887-46a7-88f4-af7ad526cfe3 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:48.947924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 697/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:51.079245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbacf6-1745-48b0-a6f1-3263736f9422 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:51.080039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbacf6-1745-48b0-a6f1-3263736f9422 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:51.080039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbacf6-1745-48b0-a6f1-3263736f9422 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:51.081270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 683/1380] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:51.086411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24429a-4f58-41ef-83ef-8ea0d65af924 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:51.086871 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24429a-4f58-41ef-83ef-8ea0d65af924 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:51.086959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24429a-4f58-41ef-83ef-8ea0d65af924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:51.164200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5c24429a-4f58-41ef-83ef-8ea0d65af924 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:51.165478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c24429a-4f58-41ef-83ef-8ea0d65af924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:51.266539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:51.275960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 698/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:51.318506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbacf6-1745-48b0-a6f1-3263736f9422 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:51.320852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8abbacf6-1745-48b0-a6f1-3263736f9422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:51.474492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:51.488503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbacf6-1745-48b0-a6f1-3263736f9422 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:51.608898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:51.609636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:51.609985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:51.610328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:51.612103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:51.715710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:51.717394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55651483-2fec-411d-b9fa-1195f8eb74d4 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:51.729341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:51.738713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 684/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:53.833209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62909-15be-48aa-b323-04a408f33b75 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:53.833610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62909-15be-48aa-b323-04a408f33b75 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:53.833778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62909-15be-48aa-b323-04a408f33b75 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:53.835176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 699/1383] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:28:53.840483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baf2aa-85f7-41ea-9b3a-45412950ee7d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:53.840938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baf2aa-85f7-41ea-9b3a-45412950ee7d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:53.841100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baf2aa-85f7-41ea-9b3a-45412950ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:53.912804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-27baf2aa-85f7-41ea-9b3a-45412950ee7d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:53.914024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-27baf2aa-85f7-41ea-9b3a-45412950ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:54.020039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 685/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:54.061229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c62909-15be-48aa-b323-04a408f33b75 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:54.063028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-18c62909-15be-48aa-b323-04a408f33b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:54.212085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c62909-15be-48aa-b323-04a408f33b75 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:54.281685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:54.331219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:54.331922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:54.332210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:54.332488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:54.334176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:54.434162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:54.436393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8158a-8955-44dc-bfa6-853e2ebf3da7 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:54.460563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 700/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:56.493726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10ec24-5f20-4b89-b0cc-28c48d3d763e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:56.494257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10ec24-5f20-4b89-b0cc-28c48d3d763e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:56.494257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10ec24-5f20-4b89-b0cc-28c48d3d763e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:56.495692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 686/1386] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:56.501136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3474de6-cd60-4de8-8bd7-407cce042b4f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:56.502390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3474de6-cd60-4de8-8bd7-407cce042b4f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:56.502390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3474de6-cd60-4de8-8bd7-407cce042b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:56.572892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e3474de6-cd60-4de8-8bd7-407cce042b4f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:56.574484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e3474de6-cd60-4de8-8bd7-407cce042b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:56.619336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:56.699771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 701/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:56.748340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10ec24-5f20-4b89-b0cc-28c48d3d763e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:56.749860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5b10ec24-5f20-4b89-b0cc-28c48d3d763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:56.845261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:56.929580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10ec24-5f20-4b89-b0cc-28c48d3d763e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:57.057009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:57.057671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:57.057990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:57.058271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:57.059993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:57.100131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:57.153569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:57.155166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0847-f282-45d8-be9e-f5b237e0eead service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:57.173906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 687/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:28:59.286310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447eed1-fc06-4018-98c6-1ec15e35c8ea None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:59.286889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447eed1-fc06-4018-98c6-1ec15e35c8ea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:59.286889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447eed1-fc06-4018-98c6-1ec15e35c8ea None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:59.288280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 702/1389] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:28:59.293491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbd5d-1f54-4ce9-8a04-cc2611e47504 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:59.293920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbd5d-1f54-4ce9-8a04-cc2611e47504 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:59.294036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbd5d-1f54-4ce9-8a04-cc2611e47504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:59.362415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4b6fbd5d-1f54-4ce9-8a04-cc2611e47504 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:28:59.363642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b6fbd5d-1f54-4ce9-8a04-cc2611e47504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:59.462120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 688/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:28:59.506971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447eed1-fc06-4018-98c6-1ec15e35c8ea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:28:59.508854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0447eed1-fc06-4018-98c6-1ec15e35c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:59.666105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447eed1-fc06-4018-98c6-1ec15e35c8ea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:28:59.682952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:59.788649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:28:59.789314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:28:59.789601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:28:59.789881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:28:59.791545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:28:59.890780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:28:59.893019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863899a-6147-4a4d-9e88-87accdc48e26 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:28:59.911369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 703/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:00.744292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409edb9-cde1-4f5d-bb24-e48caed657f2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:00.744874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409edb9-cde1-4f5d-bb24-e48caed657f2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:00.744874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409edb9-cde1-4f5d-bb24-e48caed657f2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:00.746261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 689/1392] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:00.752375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4946a-887c-441f-b378-9e652d342508 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:00.752824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4946a-887c-441f-b378-9e652d342508 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:00.752982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4946a-887c-441f-b378-9e652d342508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:00.778594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:00.822593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1eb4946a-887c-441f-b378-9e652d342508 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:00.827380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1eb4946a-887c-441f-b378-9e652d342508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:00.937889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 704/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:00.996170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589b3d-5a5d-4570-8c20-93f8a6cd1b2a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:00.996480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589b3d-5a5d-4570-8c20-93f8a6cd1b2a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:00.996767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589b3d-5a5d-4570-8c20-93f8a6cd1b2a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:00.998174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 690/1394] 10.222.0.20 () {54 vars in 966 bytes} [Wed Jul 20 09:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:01.004538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9b34c-7381-44ea-8f74-b729f8698603 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:01.004834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9b34c-7381-44ea-8f74-b729f8698603 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:01.005119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9b34c-7381-44ea-8f74-b729f8698603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:01.086456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dec9b34c-7381-44ea-8f74-b729f8698603 None None] MFA Rules not processed for user `5c6736109f3549eb85021ce2d6a23436`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:01.087706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dec9b34c-7381-44ea-8f74-b729f8698603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:01.129953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:01.167375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 705/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Wed Jul 20 09:29:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:01.179960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07589b3d-5a5d-4570-8c20-93f8a6cd1b2a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:01.179960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-07589b3d-5a5d-4570-8c20-93f8a6cd1b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:01.193554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:01.299250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07589b3d-5a5d-4570-8c20-93f8a6cd1b2a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:01.386218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:01.386871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:01.387155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:01.387428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:01.389135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:01.463454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:01.507571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:01.509344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113c980-7bf4-4f22-8efc-fd916bf5c499 service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:01.527521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 691/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:02.006259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90862-5c08-4cbb-816c-28b90674a143 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.006773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90862-5c08-4cbb-816c-28b90674a143 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.006870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90862-5c08-4cbb-816c-28b90674a143 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.008381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 706/1397] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:02.013872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5de2-c3b4-4696-9daa-d67f02b2a52c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.014297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5de2-c3b4-4696-9daa-d67f02b2a52c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.014459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5de2-c3b4-4696-9daa-d67f02b2a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.082092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bfda5de2-c3b4-4696-9daa-d67f02b2a52c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:02.083323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bfda5de2-c3b4-4696-9daa-d67f02b2a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.199238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 692/1398] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:02.247072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90862-5c08-4cbb-816c-28b90674a143 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:02.248524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e4c90862-5c08-4cbb-816c-28b90674a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.259654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27d86-7ade-4ff8-af4a-dedd9f659b68 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.259981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27d86-7ade-4ff8-af4a-dedd9f659b68 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.260257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27d86-7ade-4ff8-af4a-dedd9f659b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.287469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:02.330488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-25f27d86-7ade-4ff8-af4a-dedd9f659b68 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:02.331653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-25f27d86-7ade-4ff8-af4a-dedd9f659b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.403364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90862-5c08-4cbb-816c-28b90674a143 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:02.419623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 693/1399] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:29:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:29:02.461460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:02.469686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c94c1-cad3-48ea-83fe-d3445e6e9117 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.470528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c94c1-cad3-48ea-83fe-d3445e6e9117 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.470805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c94c1-cad3-48ea-83fe-d3445e6e9117 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.472230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 694/1400] 10.222.0.20 () {54 vars in 943 bytes} [Wed Jul 20 09:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:29:02.480926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158035-6f11-4523-a192-15cf9c5f7ea2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.481337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158035-6f11-4523-a192-15cf9c5f7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.481653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158035-6f11-4523-a192-15cf9c5f7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.539850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:02.540587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.540871 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.541148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.542826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.566295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-11158035-6f11-4523-a192-15cf9c5f7ea2 None None] MFA Rules not processed for user `92eaddc698594f328d27c7e3c7bf6a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:02.567483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-11158035-6f11-4523-a192-15cf9c5f7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.622814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:02.635684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:02.637579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:02.657022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 707/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:02.679042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 695/1402] 10.222.0.20 () {58 vars in 1040 bytes} [Wed Jul 20 09:29:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:02.689596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:02.690815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.756564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:02.793838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da5aa-44b2-4e19-af78-507c8a026049 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:02.912384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:02.913034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:02.913315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:02.913588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:02.915256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:02.999106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:03.000657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533a92-ff22-4d13-9d89-c27b1a80ab22 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:03.005607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:03.010608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 708/1403] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:29:04.761855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e59ef-18db-4f2b-9a7b-2cebdb731c6d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:04.762396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e59ef-18db-4f2b-9a7b-2cebdb731c6d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:04.762396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e59ef-18db-4f2b-9a7b-2cebdb731c6d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:04.763786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 696/1404] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:04.769102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c598b-427b-4583-ba81-b4f530e88317 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:04.769553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c598b-427b-4583-ba81-b4f530e88317 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:04.769637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c598b-427b-4583-ba81-b4f530e88317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:04.852124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-411c598b-427b-4583-ba81-b4f530e88317 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:04.853357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-411c598b-427b-4583-ba81-b4f530e88317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:04.974110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 709/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:05.021987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e59ef-18db-4f2b-9a7b-2cebdb731c6d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:05.023502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-016e59ef-18db-4f2b-9a7b-2cebdb731c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:05.198421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e59ef-18db-4f2b-9a7b-2cebdb731c6d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:05.243075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:05.364036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:05.364601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:05.364882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:05.365155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:05.366815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:05.475215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:05.477785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f6c93-3491-4f4b-8301-e37481fac5e8 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:05.499622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 697/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:07.602285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bc23-0883-498f-9ae2-a3d585e0ee3d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:07.602816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bc23-0883-498f-9ae2-a3d585e0ee3d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:07.602816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bc23-0883-498f-9ae2-a3d585e0ee3d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:07.604586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 710/1407] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:07.610968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66c06a-c4db-4f67-8954-cad6e93f6738 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:07.611408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66c06a-c4db-4f67-8954-cad6e93f6738 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:07.611612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66c06a-c4db-4f67-8954-cad6e93f6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:07.659238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:07.688640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ae66c06a-c4db-4f67-8954-cad6e93f6738 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:07.689860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ae66c06a-c4db-4f67-8954-cad6e93f6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:07.798974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 698/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:07.844024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474bc23-0883-498f-9ae2-a3d585e0ee3d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:07.845816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5474bc23-0883-498f-9ae2-a3d585e0ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:07.949475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:08.027209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474bc23-0883-498f-9ae2-a3d585e0ee3d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:08.159404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:08.160151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:08.160474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:08.160791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:08.162488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:08.216582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:08.272417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:08.274075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2df6c-e10c-4ba2-8198-cecc362d163b service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:08.293887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 711/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:17.797063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=51 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:18.291498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=27 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:25.345469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5f51-c2f1-413d-a9d6-aa2b5163b6af None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:25.346085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5f51-c2f1-413d-a9d6-aa2b5163b6af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:25.346085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5f51-c2f1-413d-a9d6-aa2b5163b6af None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:25.347495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 699/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Jul 20 09:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:25.352972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ee07e-934a-42d8-ab60-12364f31b761 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:25.353429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ee07e-934a-42d8-ab60-12364f31b761 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:25.353542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ee07e-934a-42d8-ab60-12364f31b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:25.427010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c39ee07e-934a-42d8-ab60-12364f31b761 None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:25.428237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c39ee07e-934a-42d8-ab60-12364f31b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:25.533531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 712/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Jul 20 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:25.551371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863997c2-8ad0-4691-b1ae-dfc1e757982d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:25.551661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863997c2-8ad0-4691-b1ae-dfc1e757982d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:25.551970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863997c2-8ad0-4691-b1ae-dfc1e757982d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:25.553320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 700/1412] 10.222.0.20 () {54 vars in 918 bytes} [Wed Jul 20 09:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:25.558163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fead8-9989-4851-9e83-26d1ab5b35e2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:25.558452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fead8-9989-4851-9e83-26d1ab5b35e2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:25.558727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fead8-9989-4851-9e83-26d1ab5b35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:25.629495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:25.633881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-655fead8-9989-4851-9e83-26d1ab5b35e2 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:25.635954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-655fead8-9989-4851-9e83-26d1ab5b35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:25.750567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 713/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Jul 20 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:28.326316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b931-26ba-4aa0-a1a8-bfa6ad9a8c5b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:28.326881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b931-26ba-4aa0-a1a8-bfa6ad9a8c5b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:28.326881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b931-26ba-4aa0-a1a8-bfa6ad9a8c5b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:28.328297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:28.333624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad91271-da57-4ddd-b1c0-171068535655 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:28.334068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad91271-da57-4ddd-b1c0-171068535655 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:28.334183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad91271-da57-4ddd-b1c0-171068535655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:28.398473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6ad91271-da57-4ddd-b1c0-171068535655 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:28.399604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6ad91271-da57-4ddd-b1c0-171068535655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:28.454530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:28.497686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:28.541288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6b931-26ba-4aa0-a1a8-bfa6ad9a8c5b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:28.542942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-57f6b931-26ba-4aa0-a1a8-bfa6ad9a8c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:28.687152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6b931-26ba-4aa0-a1a8-bfa6ad9a8c5b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:28.758828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:28.800369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:28.801052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:28.801302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:28.801589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:28.803248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:28.897836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:28.899431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cfe0f-09d2-4f6f-817d-8bdf986a12b5 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:28.917509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 702/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:29.831188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218fc4-6348-4b3d-9eb0-cccaa15e82e6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:29.831684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218fc4-6348-4b3d-9eb0-cccaa15e82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:29.831824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218fc4-6348-4b3d-9eb0-cccaa15e82e6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:29.833162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:29.838149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7aadb-4e16-4ade-a498-d50fe294365f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:29.838595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7aadb-4e16-4ade-a498-d50fe294365f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:29.838706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7aadb-4e16-4ade-a498-d50fe294365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:30.037040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-10f7aadb-4e16-4ade-a498-d50fe294365f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:30.038259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-10f7aadb-4e16-4ade-a498-d50fe294365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:30.065530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:30.134940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:30.291657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218fc4-6348-4b3d-9eb0-cccaa15e82e6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:30.293216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-92218fc4-6348-4b3d-9eb0-cccaa15e82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:30.438289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218fc4-6348-4b3d-9eb0-cccaa15e82e6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:30.477926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:30.551402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:30.552096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:30.552382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:30.552659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:30.554320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:30.644444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:30.646057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9d13e-04ad-4167-9f47-f208548f8a5e service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:30.663872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 716/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:31.549754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8af81e-4d8b-4913-8b6c-914c962b570b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:31.550354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8af81e-4d8b-4913-8b6c-914c962b570b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:31.550354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8af81e-4d8b-4913-8b6c-914c962b570b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:31.551671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:31.556538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eb6e0-03e1-48b5-8179-9f5a5f177de5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:31.556985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eb6e0-03e1-48b5-8179-9f5a5f177de5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:31.557104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eb6e0-03e1-48b5-8179-9f5a5f177de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:31.610926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:31.633208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-964eb6e0-03e1-48b5-8179-9f5a5f177de5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:31.634723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-964eb6e0-03e1-48b5-8179-9f5a5f177de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:31.734059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:31.886523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8af81e-4d8b-4913-8b6c-914c962b570b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:31.888098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b8af81e-4d8b-4913-8b6c-914c962b570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:32.043246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8af81e-4d8b-4913-8b6c-914c962b570b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:32.055402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:32.157831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:32.158393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:32.158674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:32.158949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:32.160635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:32.248492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:32.250100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee173021-4994-41ad-bd0b-234f3aaaeb30 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:32.269037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 705/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:33.173325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b8bc-3911-491c-b45c-b83964a10af3 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:33.173849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b8bc-3911-491c-b45c-b83964a10af3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:33.173849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b8bc-3911-491c-b45c-b83964a10af3 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:33.175198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:33.180328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3813e-b454-49b4-9686-da917c6e5b75 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:33.180793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3813e-b454-49b4-9686-da917c6e5b75 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:33.180905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3813e-b454-49b4-9686-da917c6e5b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:33.198678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:33.261570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-85e3813e-b454-49b4-9686-da917c6e5b75 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:33.262860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-85e3813e-b454-49b4-9686-da917c6e5b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:33.359663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:33.505899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b8bc-3911-491c-b45c-b83964a10af3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:33.507406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bd87b8bc-3911-491c-b45c-b83964a10af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:33.623557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:33.664020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b8bc-3911-491c-b45c-b83964a10af3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:33.776802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:33.777378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:33.777662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:33.777936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:33.779622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:33.857134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:33.876951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:33.880024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811ed9e-a1d1-49a2-a0d9-51f4c25896b1 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:33.903835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 719/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:34.780105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fba0d-c5b3-4cab-80f0-ce446ee15399 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:34.780677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fba0d-c5b3-4cab-80f0-ce446ee15399 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:34.780677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fba0d-c5b3-4cab-80f0-ce446ee15399 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:34.782114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:34.787180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94663403-7698-49a2-b085-353d951e4258 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:34.787606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94663403-7698-49a2-b085-353d951e4258 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:34.787752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94663403-7698-49a2-b085-353d951e4258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:34.862455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-94663403-7698-49a2-b085-353d951e4258 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:34.863681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-94663403-7698-49a2-b085-353d951e4258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:34.961872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:35.112162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fba0d-c5b3-4cab-80f0-ce446ee15399 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:35.113634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b64fba0d-c5b3-4cab-80f0-ce446ee15399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:35.205946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:35.267398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fba0d-c5b3-4cab-80f0-ce446ee15399 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:35.379468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:35.380063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:35.380350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:35.380623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:35.382281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:35.430252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:35.471607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:35.473218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b5770-6b88-4f88-be83-030d25ef34f8 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:35.491842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 708/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:36.301633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000d404-ab19-4b98-9a9e-daf800bb9a77 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:36.302293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000d404-ab19-4b98-9a9e-daf800bb9a77 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:36.302293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000d404-ab19-4b98-9a9e-daf800bb9a77 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:36.303576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:36.308665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2034c-d892-4ad4-a3f9-f47af552139f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:36.309103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2034c-d892-4ad4-a3f9-f47af552139f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:36.309222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2034c-d892-4ad4-a3f9-f47af552139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:36.381790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-85c2034c-d892-4ad4-a3f9-f47af552139f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:36.382995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-85c2034c-d892-4ad4-a3f9-f47af552139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:36.479467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:36.630091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000d404-ab19-4b98-9a9e-daf800bb9a77 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:36.631541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8000d404-ab19-4b98-9a9e-daf800bb9a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:36.680664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:36.777453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000d404-ab19-4b98-9a9e-daf800bb9a77 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:36.890247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:36.890814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:36.891094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:36.891973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:36.893653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:36.901682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:36.986282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:36.987910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443145e-3750-4e13-aba4-ae91a6573510 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:37.006488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 722/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:37.817529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e9782-38e2-4138-9963-a29878d77246 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:37.818097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e9782-38e2-4138-9963-a29878d77246 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:37.818097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e9782-38e2-4138-9963-a29878d77246 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:37.819409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:37.824364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5dfd3-6d47-489e-8343-f27b1a6f32c7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:37.824784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5dfd3-6d47-489e-8343-f27b1a6f32c7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:37.824932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5dfd3-6d47-489e-8343-f27b1a6f32c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:37.901199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-afe5dfd3-6d47-489e-8343-f27b1a6f32c7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:37.902437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-afe5dfd3-6d47-489e-8343-f27b1a6f32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:37.976676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:38.005675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:38.157386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e9782-38e2-4138-9963-a29878d77246 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:38.158907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cb1e9782-38e2-4138-9963-a29878d77246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:38.176239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:38.307288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e9782-38e2-4138-9963-a29878d77246 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:38.395287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:38.420751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:38.421398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:38.421676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:38.421948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:38.424111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:38.511069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:38.512658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b48b77-4880-400b-be58-43bb2da257c9 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:38.530385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 711/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:39.337482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d376-030c-4de3-b1e8-8b965c14a7fd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:39.337987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d376-030c-4de3-b1e8-8b965c14a7fd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:39.338093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d376-030c-4de3-b1e8-8b965c14a7fd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:39.339485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:39.344555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99304d-042c-4475-9c99-0d4fadafaf2b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:39.344990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99304d-042c-4475-9c99-0d4fadafaf2b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:39.345111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99304d-042c-4475-9c99-0d4fadafaf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:39.418630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3d99304d-042c-4475-9c99-0d4fadafaf2b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:39.419791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d99304d-042c-4475-9c99-0d4fadafaf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:39.461725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:39.516772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:39.666859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d376-030c-4de3-b1e8-8b965c14a7fd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:39.668390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8219d376-030c-4de3-b1e8-8b965c14a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:39.814823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d376-030c-4de3-b1e8-8b965c14a7fd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:39.869547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:39.933502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:39.934158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:39.934444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:39.934720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:39.936419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:40.027085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:40.028707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef680d-52e4-4b6f-b13d-454c2be545e3 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:40.047145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 725/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:40.842915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406e7f-aa96-4264-88fd-ad9a853fdbfd None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:40.843341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406e7f-aa96-4264-88fd-ad9a853fdbfd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:40.843476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406e7f-aa96-4264-88fd-ad9a853fdbfd None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:40.844927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:40.849907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580803-cbf3-4bfa-9cca-9401c93cf052 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:40.850354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580803-cbf3-4bfa-9cca-9401c93cf052 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:40.850460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580803-cbf3-4bfa-9cca-9401c93cf052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:40.925088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cb580803-cbf3-4bfa-9cca-9401c93cf052 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:40.926306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cb580803-cbf3-4bfa-9cca-9401c93cf052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:40.928338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:41.024003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:41.174281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98406e7f-aa96-4264-88fd-ad9a853fdbfd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:41.175764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-98406e7f-aa96-4264-88fd-ad9a853fdbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:41.318565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98406e7f-aa96-4264-88fd-ad9a853fdbfd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:41.348334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:41.438262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:41.438823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:41.439106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:41.439381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:41.441077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:41.533476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:41.535082 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4714-7de5-4d9b-b8c2-8602e19b0a5a service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:41.553965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 714/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:43.541626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5086283-33b8-4581-a687-1b1c8b49def4 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:43.542208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5086283-33b8-4581-a687-1b1c8b49def4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:43.542208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5086283-33b8-4581-a687-1b1c8b49def4 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:43.543556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:43.549530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557f1a-f575-4008-b6ea-8c5d4b53949f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:43.550011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557f1a-f575-4008-b6ea-8c5d4b53949f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:43.550119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557f1a-f575-4008-b6ea-8c5d4b53949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:43.588912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:43.614950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-33557f1a-f575-4008-b6ea-8c5d4b53949f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:43.616201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-33557f1a-f575-4008-b6ea-8c5d4b53949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:43.712211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:43.755862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5086283-33b8-4581-a687-1b1c8b49def4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:43.757418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f5086283-33b8-4581-a687-1b1c8b49def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:43.861912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5086283-33b8-4581-a687-1b1c8b49def4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:43.894916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:43.937523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:43.938185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:43.938470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:43.938748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:43.940464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:44.055087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:44.056562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba2127-2e00-434e-90a1-230ac3ba89bb service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:44.075775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 728/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:46.334133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5f777-1d9c-4837-99ac-61c97df8ef4e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:46.334698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5f777-1d9c-4837-99ac-61c97df8ef4e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:46.334698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5f777-1d9c-4837-99ac-61c97df8ef4e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:46.336086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:46.341395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f49d-0bfc-492d-8727-8acc3b13295f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:46.341781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f49d-0bfc-492d-8727-8acc3b13295f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:46.341989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f49d-0bfc-492d-8727-8acc3b13295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:46.406500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ab08f49d-0bfc-492d-8727-8acc3b13295f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:46.408248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ab08f49d-0bfc-492d-8727-8acc3b13295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:46.422346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:46.506091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:46.544556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5f777-1d9c-4837-99ac-61c97df8ef4e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:46.546120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-05c5f777-1d9c-4837-99ac-61c97df8ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:46.651913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5f777-1d9c-4837-99ac-61c97df8ef4e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:46.664748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:46.727098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:46.727779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:46.728066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:46.728342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:46.729989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:46.840189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:46.841625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57669e4-22f4-472c-a72e-3136162a3de9 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:46.859756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 717/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:49.232277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bc39-d22f-4d00-a63f-23aec869ff36 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:49.232825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bc39-d22f-4d00-a63f-23aec869ff36 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:49.232934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bc39-d22f-4d00-a63f-23aec869ff36 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:49.234258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:49.239614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d314-5e37-4567-bf16-3d984febc64b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:49.240036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d314-5e37-4567-bf16-3d984febc64b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:49.240200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d314-5e37-4567-bf16-3d984febc64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:49.288852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:49.306382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2857d314-5e37-4567-bf16-3d984febc64b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:49.307598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2857d314-5e37-4567-bf16-3d984febc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:49.416924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:49.456382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bc39-d22f-4d00-a63f-23aec869ff36 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:49.457992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d016bc39-d22f-4d00-a63f-23aec869ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:49.563734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bc39-d22f-4d00-a63f-23aec869ff36 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:49.604075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:49.638494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:49.639157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:49.639436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:49.639734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:49.641380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:49.765918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:49.767352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67536554-a913-4d43-b844-3e97d884c93d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:49.785361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 731/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:51.955209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f6de-ee61-4de5-8f16-13dff5fb05e6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:51.955757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f6de-ee61-4de5-8f16-13dff5fb05e6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:51.955886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f6de-ee61-4de5-8f16-13dff5fb05e6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:51.957167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:51.962597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312dc42-c185-4e8f-a2e1-f19c8e39bf76 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:51.963025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312dc42-c185-4e8f-a2e1-f19c8e39bf76 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:51.963155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312dc42-c185-4e8f-a2e1-f19c8e39bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:52.028620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8312dc42-c185-4e8f-a2e1-f19c8e39bf76 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:52.029862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8312dc42-c185-4e8f-a2e1-f19c8e39bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:52.054562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:52.133890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:52.174591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f6de-ee61-4de5-8f16-13dff5fb05e6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:52.176200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9433f6de-ee61-4de5-8f16-13dff5fb05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:52.279037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f6de-ee61-4de5-8f16-13dff5fb05e6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:52.298152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:52.351871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:52.352520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:52.352805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:52.353083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:52.354732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:52.466403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:52.467871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3854-979e-4125-8111-1940b9f5b47e service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:52.489890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 720/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:29:54.584988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35682b99-3b3d-42a6-800c-aeecc85fd02e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:54.585555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35682b99-3b3d-42a6-800c-aeecc85fd02e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:54.585555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35682b99-3b3d-42a6-800c-aeecc85fd02e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:54.586948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:29:54.592347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256f19-16f7-49e9-8e42-a28e0b075ec3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:54.592756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256f19-16f7-49e9-8e42-a28e0b075ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:54.592904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256f19-16f7-49e9-8e42-a28e0b075ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:54.654854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:54.658131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c0256f19-16f7-49e9-8e42-a28e0b075ec3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:54.659869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c0256f19-16f7-49e9-8e42-a28e0b075ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:54.755410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:54.793843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35682b99-3b3d-42a6-800c-aeecc85fd02e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:54.795384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-35682b99-3b3d-42a6-800c-aeecc85fd02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:54.903074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35682b99-3b3d-42a6-800c-aeecc85fd02e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:54.952283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:54.976492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:54.977361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:54.977464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:54.977718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:54.979768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:55.089473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:55.090834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75906be9-8ede-463c-8a49-1da007cb60fa service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:55.109509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 734/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:57.196922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bdcd1-d1cd-4896-b43c-1f96f7029e6f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:57.197493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bdcd1-d1cd-4896-b43c-1f96f7029e6f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:57.197493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bdcd1-d1cd-4896-b43c-1f96f7029e6f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:57.198827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:57.204205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fdeb7-8845-469c-9b9f-0155e58d2b13 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:57.204646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fdeb7-8845-469c-9b9f-0155e58d2b13 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:57.204813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fdeb7-8845-469c-9b9f-0155e58d2b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:57.269385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-591fdeb7-8845-469c-9b9f-0155e58d2b13 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:57.270608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-591fdeb7-8845-469c-9b9f-0155e58d2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:57.300634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:57.368028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:29:57.407457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bdcd1-d1cd-4896-b43c-1f96f7029e6f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:29:57.409116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2b1bdcd1-d1cd-4896-b43c-1f96f7029e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:57.520243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bdcd1-d1cd-4896-b43c-1f96f7029e6f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:29:57.549219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:57.593995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:29:57.594652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:57.594940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:57.595218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:57.597428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:57.705788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:29:57.707214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f91d-33da-4f52-b710-ad3d3297d445 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:29:57.726886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 723/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:59.873288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832a43-f0db-46ab-941f-784896ff5405 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:59.873868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832a43-f0db-46ab-941f-784896ff5405 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:59.873868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832a43-f0db-46ab-941f-784896ff5405 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:59.875258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:29:59.882033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e76d4-6043-4077-a58d-6d828f73d15b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:29:59.882576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e76d4-6043-4077-a58d-6d828f73d15b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:29:59.883068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e76d4-6043-4077-a58d-6d828f73d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:29:59.951510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7d0e76d4-6043-4077-a58d-6d828f73d15b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:29:59.952945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7d0e76d4-6043-4077-a58d-6d828f73d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:29:59.961331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:00.052755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:00.089998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832a43-f0db-46ab-941f-784896ff5405 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:00.091587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-38832a43-f0db-46ab-941f-784896ff5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:00.211208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832a43-f0db-46ab-941f-784896ff5405 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:00.268561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:00.288184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:00.288843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:00.289123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:00.289392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:00.291040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:00.400851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:00.402200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cba63-d669-43ec-bc65-d315aaecf901 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:00.420650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 737/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:02.506643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c405b0-f7a2-46ac-9ab3-cfc6e40b5654 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:02.507174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c405b0-f7a2-46ac-9ab3-cfc6e40b5654 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:02.507174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c405b0-f7a2-46ac-9ab3-cfc6e40b5654 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:02.508635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:02.514303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b24b3-5989-4aff-bdfe-5b80abada195 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:02.514761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b24b3-5989-4aff-bdfe-5b80abada195 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:02.514860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b24b3-5989-4aff-bdfe-5b80abada195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:02.579012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d89b24b3-5989-4aff-bdfe-5b80abada195 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:02.580767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d89b24b3-5989-4aff-bdfe-5b80abada195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:02.618924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:02.677275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:02.715915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c405b0-f7a2-46ac-9ab3-cfc6e40b5654 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:02.717434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c9c405b0-f7a2-46ac-9ab3-cfc6e40b5654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:02.822426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c405b0-f7a2-46ac-9ab3-cfc6e40b5654 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:02.865305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:02.903504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:02.904182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:02.904465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:02.904738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:02.906375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:03.013125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:03.014546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328105b7-c0c9-4b09-beba-ba38ec23b1da service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:03.033622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 726/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:05.123866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e871f4-3bc5-4cb1-8b74-c6d09313f47f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:05.124385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e871f4-3bc5-4cb1-8b74-c6d09313f47f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:05.124385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e871f4-3bc5-4cb1-8b74-c6d09313f47f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:05.125717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:05.131511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159a28-778b-43b0-975a-1d0404e944a1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:05.132002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159a28-778b-43b0-975a-1d0404e944a1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:05.132148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159a28-778b-43b0-975a-1d0404e944a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:05.210224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-24159a28-778b-43b0-975a-1d0404e944a1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:05.211439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-24159a28-778b-43b0-975a-1d0404e944a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:05.229149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:05.306280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:05.344707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e871f4-3bc5-4cb1-8b74-c6d09313f47f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:05.346521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-30e871f4-3bc5-4cb1-8b74-c6d09313f47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:05.449994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e871f4-3bc5-4cb1-8b74-c6d09313f47f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:05.520469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:05.528203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:05.528521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:05.528706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:05.528985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:05.530642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:05.639864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:05.641293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520661dc-b889-4b26-b7d1-9091c0f908b5 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:05.659046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 740/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:07.770356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb126e-2d31-4403-9db2-d3b22efbe884 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:07.770965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb126e-2d31-4403-9db2-d3b22efbe884 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:07.770965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb126e-2d31-4403-9db2-d3b22efbe884 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:07.772337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:07.778463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4e6d-56ac-4968-9824-02587399a5df None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:07.778932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4e6d-56ac-4968-9824-02587399a5df None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:07.779457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4e6d-56ac-4968-9824-02587399a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:07.850193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2c2c4e6d-56ac-4968-9824-02587399a5df None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:07.851409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2c2c4e6d-56ac-4968-9824-02587399a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:07.918929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:07.970370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:30:08.010668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb126e-2d31-4403-9db2-d3b22efbe884 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:08.013517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-61fb126e-2d31-4403-9db2-d3b22efbe884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:08.130207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb126e-2d31-4403-9db2-d3b22efbe884 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:08.178481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:08.205744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:08.206398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:08.206685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:08.206961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:08.208646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:08.325605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:08.327032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102f052-0392-457a-af7f-4d457062f27c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:08.345813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 729/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:17.968170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=22 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:18.343477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=66 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:28.265145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1994e5-6909-4f41-acff-2f7b2c2205fa None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:28.265673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1994e5-6909-4f41-acff-2f7b2c2205fa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:28.265673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1994e5-6909-4f41-acff-2f7b2c2205fa None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:28.267092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 742/1471] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:28.272417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049032-111b-4fce-a635-f9c73e3fa7d6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:28.272869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049032-111b-4fce-a635-f9c73e3fa7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:28.272975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049032-111b-4fce-a635-f9c73e3fa7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:28.340219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-39049032-111b-4fce-a635-f9c73e3fa7d6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:28.341436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39049032-111b-4fce-a635-f9c73e3fa7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:28.446918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 730/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:28.551770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6fe9d-b480-4e4f-821b-5fdd8e6dfd49 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:28.552067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6fe9d-b480-4e4f-821b-5fdd8e6dfd49 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:28.552350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6fe9d-b480-4e4f-821b-5fdd8e6dfd49 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:28.553741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 743/1473] 10.222.0.20 () {54 vars in 966 bytes} [Wed Jul 20 09:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:28.558572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a08e8-1bcc-4fe0-a249-6bd0850895ba None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:28.558861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a08e8-1bcc-4fe0-a249-6bd0850895ba None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:28.559138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a08e8-1bcc-4fe0-a249-6bd0850895ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:28.633634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-486a08e8-1bcc-4fe0-a249-6bd0850895ba None None] MFA Rules not processed for user `5c6736109f3549eb85021ce2d6a23436`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:28.634891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-486a08e8-1bcc-4fe0-a249-6bd0850895ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:28.655766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:28.711583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 731/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Wed Jul 20 09:30:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:28.718994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6fe9d-b480-4e4f-821b-5fdd8e6dfd49 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:28.721185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b2f6fe9d-b480-4e4f-821b-5fdd8e6dfd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:28.835469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6fe9d-b480-4e4f-821b-5fdd8e6dfd49 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:28.915581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:28.916261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:28.916540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:28.916807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:28.918451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:28.972506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:29.028436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:29.029878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9fce-7767-46a4-8e43-bc0711009b6e service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:29.049089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 744/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:31.224035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce97e0-a01d-4778-b1ee-0a4e58052ab4 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:31.224582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce97e0-a01d-4778-b1ee-0a4e58052ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:31.224582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce97e0-a01d-4778-b1ee-0a4e58052ab4 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:31.225971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 732/1476] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:31.231176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6742f9-ea48-4b27-8dc5-d71f22e330d7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:31.231614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6742f9-ea48-4b27-8dc5-d71f22e330d7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:31.231763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6742f9-ea48-4b27-8dc5-d71f22e330d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:31.297194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8e6742f9-ea48-4b27-8dc5-d71f22e330d7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:31.298385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8e6742f9-ea48-4b27-8dc5-d71f22e330d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:31.394932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 745/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:31.422192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce97e0-a01d-4778-b1ee-0a4e58052ab4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:31.424438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c1ce97e0-a01d-4778-b1ee-0a4e58052ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:31.554587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce97e0-a01d-4778-b1ee-0a4e58052ab4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:31.603329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:31.649351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:31.650013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:31.650297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:31.650575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:31.651404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:31.653067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:30:31.653067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:30:31.653067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:30:31.654205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038f9a-bf36-4eae-abdc-6e8158667403 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:31.676434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 733/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 20 09:30:31 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:30:33.784487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8be93-6e44-4c96-aa98-855af335059d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:33.785118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8be93-6e44-4c96-aa98-855af335059d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:33.785118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8be93-6e44-4c96-aa98-855af335059d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:33.786455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 746/1479] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:33.792651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6a7d-8690-4f6b-a265-c6d66208e07f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:33.793136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6a7d-8690-4f6b-a265-c6d66208e07f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:33.793248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6a7d-8690-4f6b-a265-c6d66208e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:33.859242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-68fa6a7d-8690-4f6b-a265-c6d66208e07f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:33.860481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68fa6a7d-8690-4f6b-a265-c6d66208e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:33.960033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 734/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:34.003653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8be93-6e44-4c96-aa98-855af335059d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:34.005207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9ef8be93-6e44-4c96-aa98-855af335059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:34.015133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:34.156481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8be93-6e44-4c96-aa98-855af335059d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:34.241940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:34.276794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:34.277452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:34.277739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:34.278041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:34.279767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:34.369268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:34.370886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba389-58ab-474b-af3a-d2a4fdd68330 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:34.389795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 747/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:36.697427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227db8-7598-441e-9e0f-99b5488d08b6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:36.697931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227db8-7598-441e-9e0f-99b5488d08b6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:36.697931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227db8-7598-441e-9e0f-99b5488d08b6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:36.699355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 735/1482] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:36.705598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a01b7-8d09-4fe5-a13d-ba96c833e52c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:36.706231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a01b7-8d09-4fe5-a13d-ba96c833e52c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:36.706231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a01b7-8d09-4fe5-a13d-ba96c833e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:36.774056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c74a01b7-8d09-4fe5-a13d-ba96c833e52c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:36.775276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c74a01b7-8d09-4fe5-a13d-ba96c833e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:36.829200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:36.883204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 748/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:36.921232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227db8-7598-441e-9e0f-99b5488d08b6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:36.922761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fc227db8-7598-441e-9e0f-99b5488d08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:36.949023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:37.034811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227db8-7598-441e-9e0f-99b5488d08b6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:37.116016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:37.116675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:37.116977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:37.117260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:37.118972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:37.204277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:37.240810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:37.242293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390ad2-6149-4083-ab9a-208ffdb37ef2 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:37.262785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 736/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:39.414001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24e37-3e44-41c6-9152-a8380499e0a2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:39.414542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24e37-3e44-41c6-9152-a8380499e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:39.414542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24e37-3e44-41c6-9152-a8380499e0a2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:39.415921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 749/1485] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:39.421405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384b8b-905e-4675-b0df-7f6aa027b04b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:39.421867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384b8b-905e-4675-b0df-7f6aa027b04b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:39.421977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384b8b-905e-4675-b0df-7f6aa027b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:39.491801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c3384b8b-905e-4675-b0df-7f6aa027b04b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:39.493020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c3384b8b-905e-4675-b0df-7f6aa027b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:39.597700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 737/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:30:39.639220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24e37-3e44-41c6-9152-a8380499e0a2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:39.641084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2ef24e37-3e44-41c6-9152-a8380499e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:39.753975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24e37-3e44-41c6-9152-a8380499e0a2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:39.833322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:39.835536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:39.836314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:39.836998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:39.837299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:39.839262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:39.957696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:39.959138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6390f-9796-4d5f-b773-6051e345be3b service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:39.978066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 750/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:30:42.211734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ae51-6fc2-4c38-a057-8d14d50d5f16 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:42.212271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ae51-6fc2-4c38-a057-8d14d50d5f16 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:42.212271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ae51-6fc2-4c38-a057-8d14d50d5f16 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:42.213663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 738/1488] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:42.219034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793fb43-b4a8-4dfa-a89d-af86999137ba None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:42.219458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793fb43-b4a8-4dfa-a89d-af86999137ba None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:42.219646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793fb43-b4a8-4dfa-a89d-af86999137ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:42.290690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8793fb43-b4a8-4dfa-a89d-af86999137ba None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:42.291930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8793fb43-b4a8-4dfa-a89d-af86999137ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:42.344900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:42.390200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 751/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:42.431694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195ae51-6fc2-4c38-a057-8d14d50d5f16 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:42.433239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7195ae51-6fc2-4c38-a057-8d14d50d5f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:42.472360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:42.551022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195ae51-6fc2-4c38-a057-8d14d50d5f16 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:42.624841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:42.625498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:42.625781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:42.626059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:42.627753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:42.710217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:42.740666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:42.742072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198bb4c-cf8e-48ed-aa37-19e30a018417 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:42.763100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 739/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:44.979883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849247-d3d7-4b48-91d1-5d98b4c6b84a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:44.980427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849247-d3d7-4b48-91d1-5d98b4c6b84a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:44.980427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849247-d3d7-4b48-91d1-5d98b4c6b84a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:44.981849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 752/1491] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 20 09:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:30:44.987629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfc40f-0436-4c52-9130-135bad5a43f3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:44.988073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfc40f-0436-4c52-9130-135bad5a43f3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:44.988252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfc40f-0436-4c52-9130-135bad5a43f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:45.053539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b4bfc40f-0436-4c52-9130-135bad5a43f3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:30:45.054752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b4bfc40f-0436-4c52-9130-135bad5a43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:45.150340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 740/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 20 09:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:30:45.189926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849247-d3d7-4b48-91d1-5d98b4c6b84a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:30:45.191458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-31849247-d3d7-4b48-91d1-5d98b4c6b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:45.296011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849247-d3d7-4b48-91d1-5d98b4c6b84a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:30:45.372426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:30:45.373089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:30:45.373373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:30:45.373649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:30:45.375311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:30:45.384523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:45.485803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:30:45.487931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b385-5555-4876-9669-5b099fb53b5c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:30:45.509428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 753/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:30:55.148497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=82 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:55.506168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=50 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:12.867518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:12.868116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:12.868116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:12.942163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:32:12.943380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:13.044471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 741/1494] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:32:13.052626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:13.053472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:13.053472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:13.128503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:32:13.129664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:13.228357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 754/1495] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:32:13.233590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:13.234910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:13.246393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e780e3-5b67-4757-bead-2b3ab03bb88f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:13.307385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:13.342465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:13.343129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:13.343416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:13.343691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:13.344490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:32:13.344795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:13.345808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:13.345808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:32:13.345808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:32:13.346695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:13.358016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 742/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:32:13.366266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:13.375936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c8891-4c35-417e-85e7-da59788468a7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:13.436794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:13.472092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:13.472761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:13.473043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:13.473321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:13.474013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:13.475828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:13.475828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:32:13.475828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:32:13.477055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:13.538867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 755/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:32:13 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:32:13.543548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:13.545269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:13.579063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf25a1-086e-4076-8f72-0f9bd3b21270 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:13.673864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:13.674531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:13.674817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:13.675094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:13.675809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:13.676821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:13.676821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:32:13.676821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:32:13.678045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:13.717596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 743/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:32:13 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:32:13.721810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:13.723343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:13.785795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae9bac-81b7-454c-94b2-7da9dbc8b604 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:13.870597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:13.883253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:13.883962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:13.884242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:13.884514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:13.885243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:13.886266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:13.886266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:32:13.886266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:32:13.887146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:13.900081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 756/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:32:13.904296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:13.905829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:13.917361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b236-ce12-451f-9ad6-e3ab8d8e9a9c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:13.943301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:14.014438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:14.015036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:14.015319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:14.015594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:14.016391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:14.017406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:14.017406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:32:14.017406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:32:14.018287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389d26a-b4ab-4467-be2e-3f4e190ae084 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:14.030476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 744/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:32:14.035174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:14.036744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:14.071464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c3893-59e7-4358-b5bb-d78f4a3999f3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:14.283808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:14.284620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:14.284906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:14.285188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] PATH_INFO: `/v3/projects/732fb17635de4dd68ab530bd35469d3f/users/774d2999b6be4791acf813e7bd339de7/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:14.307513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=732fb17635de4dd68ab530bd35469d3f, user_id=774d2999b6be4791acf813e7bd339de7, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:14.308587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:14.308587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:32:14.308587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:32:14.310522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd951-886c-4f73-b0ce-0757864febcb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:14.335832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 757/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:32:14 2022] PUT /identity/v3/projects/732fb17635de4dd68ab530bd35469d3f/users/774d2999b6be4791acf813e7bd339de7/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:32:14.348678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9023e20-81da-4430-8666-dfd2579dc1b0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:14.348969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9023e20-81da-4430-8666-dfd2579dc1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:14.349247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9023e20-81da-4430-8666-dfd2579dc1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:14.405519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a9023e20-81da-4430-8666-dfd2579dc1b0 None None] MFA Rules not processed for user `774d2999b6be4791acf813e7bd339de7`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:32:14.407324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a9023e20-81da-4430-8666-dfd2579dc1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:14.482934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 745/1502] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:32:14.496682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171dd15-3a0f-4712-8d34-49f38696becc None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:14.496971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171dd15-3a0f-4712-8d34-49f38696becc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:14.497248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171dd15-3a0f-4712-8d34-49f38696becc None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:14.498677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 758/1503] 10.222.0.20 () {54 vars in 964 bytes} [Wed Jul 20 09:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:32:14.504004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f31cd-f50d-4102-8bf6-d2a3378fffa9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:14.504295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f31cd-f50d-4102-8bf6-d2a3378fffa9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:14.504580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f31cd-f50d-4102-8bf6-d2a3378fffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:14.535503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:14.579645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8d2f31cd-f50d-4102-8bf6-d2a3378fffa9 None None] MFA Rules not processed for user `92f96e51cfa14f148a5dd3ebd18f591c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:32:14.580896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8d2f31cd-f50d-4102-8bf6-d2a3378fffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:14.662899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 746/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Jul 20 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:32:14.670595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171dd15-3a0f-4712-8d34-49f38696becc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:14.672350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7171dd15-3a0f-4712-8d34-49f38696becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:14.721950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:14.777388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171dd15-3a0f-4712-8d34-49f38696becc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:14.851009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:14.851666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:14.851980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:14.852258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:14.853907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:14.954027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:14.955472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:14.959008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:14.975422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 759/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:32:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:32:15.025471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fc0f6-cfe1-499d-ac31-540557805928 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:15.025947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fc0f6-cfe1-499d-ac31-540557805928 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:15.026038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fc0f6-cfe1-499d-ac31-540557805928 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:15.027278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 747/1506] 10.222.0.20 () {52 vars in 829 bytes} [Wed Jul 20 09:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:32:15.030906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:15.032714 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:15.132474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0617-66a9-4916-87c8-cce8e92a9223 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:15.224835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:15.225695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:15.225968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:15.226235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] PATH_INFO: `/v3/users/774d2999b6be4791acf813e7bd339de7` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:15.238935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=774d2999b6be4791acf813e7bd339de7)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:15.240029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:15.240029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:32:15.240029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:32:15.241269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:15.251776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:15.307025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774d2999b6be4791acf813e7bd339de7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:15.316211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774d2999b6be4791acf813e7bd339de7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:15.334609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774d2999b6be4791acf813e7bd339de7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:15.335051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774d2999b6be4791acf813e7bd339de7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:15.347669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774d2999b6be4791acf813e7bd339de7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:15.353361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 760/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:32:15 2022] DELETE /identity/v3/users/774d2999b6be4791acf813e7bd339de7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:32:15.357867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:15.358276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:15.358661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:15.416271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:32:15.417402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:15.493456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:15.508088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 748/1508] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:32:15.518585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:15.519851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:15.617491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad06b4-f5cd-4778-8beb-fd56993c88ae admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:15.674882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:15.696818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:15.697482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:15.697764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:15.698040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:15.699686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:15.808080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:15.809525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86666ce9-d1fe-4f07-9a28-f7fea60a69c5 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:15.829315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 761/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:32:16.258841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:32:16.260141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:32:16.273030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d3be1-326b-4f1f-bcbc-5ae6d7af5989 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:32:16.369424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:32:16.370209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:32:16.370492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:32:16.370773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] PATH_INFO: `/v3/projects/732fb17635de4dd68ab530bd35469d3f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:32:16.380876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732fb17635de4dd68ab530bd35469d3f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:32:16.381900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:32:16.381900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:32:16.381900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:32:16.383092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:32:16.440591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732fb17635de4dd68ab530bd35469d3f', 'request_id': 'req-b7e1d414-6d13-4005-a991-fc23822261b7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:16.449184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732fb17635de4dd68ab530bd35469d3f', 'request_id': 'req-b7e1d414-6d13-4005-a991-fc23822261b7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:16.455371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732fb17635de4dd68ab530bd35469d3f', 'request_id': 'req-b7e1d414-6d13-4005-a991-fc23822261b7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:16.489670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] The token cache is being invalidate because project 732fb17635de4dd68ab530bd35469d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:32:16.490007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:16.490392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b7e1d414-6d13-4005-a991-fc23822261b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:32:16.492114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 749/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:32:16 2022] DELETE /identity/v3/projects/732fb17635de4dd68ab530bd35469d3f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:32:25.826520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=62 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:32:26.487302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:34:01.181667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996776c-2a0e-4238-8a16-5f4750264a01 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:01.182235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996776c-2a0e-4238-8a16-5f4750264a01 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:01.182235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996776c-2a0e-4238-8a16-5f4750264a01 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:01.183588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:01.189291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe258e3-a268-4fa1-8521-a0fd7d2e8f3e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:01.189796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe258e3-a268-4fa1-8521-a0fd7d2e8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:01.189894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe258e3-a268-4fa1-8521-a0fd7d2e8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:01.283539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ebe258e3-a268-4fa1-8521-a0fd7d2e8f3e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:01.284784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ebe258e3-a268-4fa1-8521-a0fd7d2e8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:01.386540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:01.544081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996776c-2a0e-4238-8a16-5f4750264a01 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:01.546325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6996776c-2a0e-4238-8a16-5f4750264a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:01.665842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996776c-2a0e-4238-8a16-5f4750264a01 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:01.671618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b525f-a43f-490c-826a-b1bb9cdd2346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:01.672301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b525f-a43f-490c-826a-b1bb9cdd2346 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:01.673132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b525f-a43f-490c-826a-b1bb9cdd2346 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:01.673378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b525f-a43f-490c-826a-b1bb9cdd2346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:01.681706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b525f-a43f-490c-826a-b1bb9cdd2346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:01.683290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b525f-a43f-490c-826a-b1bb9cdd2346 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:01.693967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 763/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:02.548105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57674-3991-4c8c-bdbf-cec690080c90 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:02.548716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57674-3991-4c8c-bdbf-cec690080c90 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:02.548716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57674-3991-4c8c-bdbf-cec690080c90 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:02.550056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:02.555103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70643813-d9c0-4861-b0e5-d8c1d25d0dd6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:02.555539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70643813-d9c0-4861-b0e5-d8c1d25d0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:02.555651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70643813-d9c0-4861-b0e5-d8c1d25d0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:02.573878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-70643813-d9c0-4861-b0e5-d8c1d25d0dd6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:02.575098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-70643813-d9c0-4861-b0e5-d8c1d25d0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:02.584208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:02.737423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57674-3991-4c8c-bdbf-cec690080c90 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:02.752491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57674-3991-4c8c-bdbf-cec690080c90 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:02.758416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af340187-4e1a-4fd2-aaba-25b324c9b206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:02.758867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af340187-4e1a-4fd2-aaba-25b324c9b206 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:02.759153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af340187-4e1a-4fd2-aaba-25b324c9b206 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:02.759430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af340187-4e1a-4fd2-aaba-25b324c9b206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:02.769953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af340187-4e1a-4fd2-aaba-25b324c9b206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:02.771626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af340187-4e1a-4fd2-aaba-25b324c9b206 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:02.781627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 752/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:03.315321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec696f9-3d93-4dfc-9cc6-bb27720627d5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:03.315607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec696f9-3d93-4dfc-9cc6-bb27720627d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:03.315912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec696f9-3d93-4dfc-9cc6-bb27720627d5 None None] PATH_INFO: `/v3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:03.317240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 765/1517] 10.222.0.43 () {54 vars in 925 bytes} [Wed Jul 20 09:34:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:34:03.324177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206fea-3f76-4052-bc86-bd3aeb62ddc9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:03.324488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206fea-3f76-4052-bc86-bd3aeb62ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:03.324762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206fea-3f76-4052-bc86-bd3aeb62ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:03.383566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-39206fea-3f76-4052-bc86-bd3aeb62ddc9 None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:03.384818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39206fea-3f76-4052-bc86-bd3aeb62ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:03.406796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:34:03.462200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 753/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 20 09:34:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:07.310725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e865ae-f69d-4bd4-8482-63c78e426ad6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:07.311490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e865ae-f69d-4bd4-8482-63c78e426ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:07.311490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e865ae-f69d-4bd4-8482-63c78e426ad6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:07.312613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 766/1519] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 20 09:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:07.318798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa65176-8cf8-44c6-93d7-b27a90be6663 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:07.319511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa65176-8cf8-44c6-93d7-b27a90be6663 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:07.319511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa65176-8cf8-44c6-93d7-b27a90be6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:07.340312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6aa65176-8cf8-44c6-93d7-b27a90be6663 None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:07.341514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6aa65176-8cf8-44c6-93d7-b27a90be6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:07.350753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 754/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 20 09:34:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:07.358673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e865ae-f69d-4bd4-8482-63c78e426ad6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:07.375934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e865ae-f69d-4bd4-8482-63c78e426ad6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:07.382531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4035d-e176-48ef-9f99-b956dbde0989 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:07.383185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4035d-e176-48ef-9f99-b956dbde0989 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:07.383471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4035d-e176-48ef-9f99-b956dbde0989 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:07.383781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4035d-e176-48ef-9f99-b956dbde0989 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:07.393477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4035d-e176-48ef-9f99-b956dbde0989 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:07.395067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4035d-e176-48ef-9f99-b956dbde0989 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:07.406756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 767/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:14.002032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5a3f-bf85-4e92-9120-664a64bac4e0 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:14.002573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5a3f-bf85-4e92-9120-664a64bac4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:14.002573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5a3f-bf85-4e92-9120-664a64bac4e0 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:14.003963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:14.008850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f398-633f-49b0-bdd5-27ac20046b6d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:14.009300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f398-633f-49b0-bdd5-27ac20046b6d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:14.009404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f398-633f-49b0-bdd5-27ac20046b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:14.027939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-39f9f398-633f-49b0-bdd5-27ac20046b6d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:14.029135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-39f9f398-633f-49b0-bdd5-27ac20046b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:14.037302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:14.191078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f5a3f-bf85-4e92-9120-664a64bac4e0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:14.206220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f5a3f-bf85-4e92-9120-664a64bac4e0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:14.211743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4875-472b-4e47-b617-97ef74233f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:14.212392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4875-472b-4e47-b617-97ef74233f1d service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:14.212677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4875-472b-4e47-b617-97ef74233f1d service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:14.212955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4875-472b-4e47-b617-97ef74233f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:14.221142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd4875-472b-4e47-b617-97ef74233f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:14.222711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd4875-472b-4e47-b617-97ef74233f1d service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:14.232199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 756/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:15.070439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eff507-04b2-46cf-a742-426d1a536f3f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:15.070980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eff507-04b2-46cf-a742-426d1a536f3f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:15.070980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eff507-04b2-46cf-a742-426d1a536f3f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:15.072404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 09:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:15.077233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d847-dc6e-4373-80f8-b3a5836691af None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:15.077637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d847-dc6e-4373-80f8-b3a5836691af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:15.077817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d847-dc6e-4373-80f8-b3a5836691af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:15.095669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2625d847-dc6e-4373-80f8-b3a5836691af None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:15.096829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2625d847-dc6e-4373-80f8-b3a5836691af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:15.104793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 09:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:15.257648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eff507-04b2-46cf-a742-426d1a536f3f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:15.272772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eff507-04b2-46cf-a742-426d1a536f3f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:15.278393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e548e5a-9aff-44bc-ae68-de24fcdc1c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:15.279048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e548e5a-9aff-44bc-ae68-de24fcdc1c08 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:15.279334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e548e5a-9aff-44bc-ae68-de24fcdc1c08 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:15.279650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e548e5a-9aff-44bc-ae68-de24fcdc1c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:15.289387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e548e5a-9aff-44bc-ae68-de24fcdc1c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:15.290988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e548e5a-9aff-44bc-ae68-de24fcdc1c08 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:15.301019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 770/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:19.822874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519f97c-b16e-4ff9-83aa-7d700a1e3674 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:19.823461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519f97c-b16e-4ff9-83aa-7d700a1e3674 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:19.823461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519f97c-b16e-4ff9-83aa-7d700a1e3674 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:19.824889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:19.830315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2010efe-244c-415c-a295-cfd090c4a7ba None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:19.830738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2010efe-244c-415c-a295-cfd090c4a7ba None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:19.830884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2010efe-244c-415c-a295-cfd090c4a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:19.848670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c2010efe-244c-415c-a295-cfd090c4a7ba None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:19.849877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c2010efe-244c-415c-a295-cfd090c4a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:19.857819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:19.935232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519f97c-b16e-4ff9-83aa-7d700a1e3674 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:19.937035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f519f97c-b16e-4ff9-83aa-7d700a1e3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:20.015158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519f97c-b16e-4ff9-83aa-7d700a1e3674 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:20.019080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070882-5b2c-44f1-9950-411c3d04eccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:20.019758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070882-5b2c-44f1-9950-411c3d04eccd service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:20.020053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070882-5b2c-44f1-9950-411c3d04eccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:20.020335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070882-5b2c-44f1-9950-411c3d04eccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:20.029574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070882-5b2c-44f1-9950-411c3d04eccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:20.030990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070882-5b2c-44f1-9950-411c3d04eccd service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:20.040934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 759/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:22.045142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2c389-d162-4dd4-a744-2099fec268fd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:22.045774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2c389-d162-4dd4-a744-2099fec268fd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:22.045774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2c389-d162-4dd4-a744-2099fec268fd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:22.047100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:34:22.052413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c30e6-7af3-4e6e-ba11-5caa8742ebb8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:22.052853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c30e6-7af3-4e6e-ba11-5caa8742ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:22.052953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c30e6-7af3-4e6e-ba11-5caa8742ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:22.070767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-610c30e6-7af3-4e6e-ba11-5caa8742ebb8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:22.072044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-610c30e6-7af3-4e6e-ba11-5caa8742ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:22.080423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:22.117042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2c389-d162-4dd4-a744-2099fec268fd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:22.128779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2c389-d162-4dd4-a744-2099fec268fd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:22.132304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030afc-a429-44e0-8b65-9d67f14dff4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:22.132941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030afc-a429-44e0-8b65-9d67f14dff4a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:22.133225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030afc-a429-44e0-8b65-9d67f14dff4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:22.133501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030afc-a429-44e0-8b65-9d67f14dff4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:22.143007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030afc-a429-44e0-8b65-9d67f14dff4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:22.144462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030afc-a429-44e0-8b65-9d67f14dff4a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:22.153782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 773/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:25.837367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254221-a32d-4c87-befa-a11617ee4712 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:25.837850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254221-a32d-4c87-befa-a11617ee4712 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:25.837971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254221-a32d-4c87-befa-a11617ee4712 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:25.839294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:25.844534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c693d-eb60-4d0a-8bbf-5fa69339cede None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:25.844980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c693d-eb60-4d0a-8bbf-5fa69339cede None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:25.845091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c693d-eb60-4d0a-8bbf-5fa69339cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:25.851224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=81 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:34:25.864571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ac8c693d-eb60-4d0a-8bbf-5fa69339cede None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:25.865763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ac8c693d-eb60-4d0a-8bbf-5fa69339cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:25.873478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:26.211515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254221-a32d-4c87-befa-a11617ee4712 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:26.213220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-78254221-a32d-4c87-befa-a11617ee4712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:26.279531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:34:26.294239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254221-a32d-4c87-befa-a11617ee4712 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:26.298550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d7efb-92c9-4219-8efe-7d70664286a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:26.299196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d7efb-92c9-4219-8efe-7d70664286a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:26.299474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d7efb-92c9-4219-8efe-7d70664286a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:26.299773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d7efb-92c9-4219-8efe-7d70664286a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:26.308825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d7efb-92c9-4219-8efe-7d70664286a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:26.310233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d7efb-92c9-4219-8efe-7d70664286a4 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:26.319646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 762/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:28.391063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f3e5f-43e8-4a92-bba5-cf937c6b0a0f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:28.391679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f3e5f-43e8-4a92-bba5-cf937c6b0a0f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:28.391822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f3e5f-43e8-4a92-bba5-cf937c6b0a0f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:28.393169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 09:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:34:28.398703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c6c5-cf7d-446d-83c2-d0df55704e5d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:28.399124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c6c5-cf7d-446d-83c2-d0df55704e5d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:28.399288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c6c5-cf7d-446d-83c2-d0df55704e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:28.417846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8815c6c5-cf7d-446d-83c2-d0df55704e5d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:34:28.419010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8815c6c5-cf7d-446d-83c2-d0df55704e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:28.427856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:34:28.738412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f3e5f-43e8-4a92-bba5-cf937c6b0a0f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:34:28.740172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9e4f3e5f-43e8-4a92-bba5-cf937c6b0a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:34:28.753908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f3e5f-43e8-4a92-bba5-cf937c6b0a0f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:34:28.757503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d9dc-15c2-437c-beba-429ccaf454dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:34:28.758145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d9dc-15c2-437c-beba-429ccaf454dc service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:34:28.758433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d9dc-15c2-437c-beba-429ccaf454dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:34:28.758715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d9dc-15c2-437c-beba-429ccaf454dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:34:28.768153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d9dc-15c2-437c-beba-429ccaf454dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:34:28.769610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d9dc-15c2-437c-beba-429ccaf454dc service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:34:28.779269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 776/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:34:38.412626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=11 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:34:38.775004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:04.228142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.229288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.229288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.259662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.261874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.273895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 764/1540] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:04.282610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.283648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.284185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.309749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.311016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.329473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 777/1541] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.334236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.346804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502b3e2-d8de-4c6f-80ea-a52a8ba45f53 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.355934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.356776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.357068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.357347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.358084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:04.358395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.360166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be8fe2-ff30-4033-b638-753b62fb7246 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.379686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 765/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:04.387297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.402143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d2664-87e7-4a2e-9010-923b1425ad27 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.412540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec395-7b29-4144-b474-8f575081a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.413242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec395-7b29-4144-b474-8f575081a989 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.413529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec395-7b29-4144-b474-8f575081a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.413805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec395-7b29-4144-b474-8f575081a989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.414513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec395-7b29-4144-b474-8f575081a989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.416480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec395-7b29-4144-b474-8f575081a989 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.453617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.453973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.454200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.481881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 778/1543] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:04.483697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115276-09c1-4bc1-9d3a-ce555e3a1109 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.484016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115276-09c1-4bc1-9d3a-ce555e3a1109 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.485016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93115276-09c1-4bc1-9d3a-ce555e3a1109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.498186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.510332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.536279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-93115276-09c1-4bc1-9d3a-ce555e3a1109 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.538734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-93115276-09c1-4bc1-9d3a-ce555e3a1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.667223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 766/1544] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:04.668158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.678935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f82b9-4fee-4073-8e35-ac740cce7958 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.683883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db9c04-a8a1-478a-8e6e-65881e15ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.684565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db9c04-a8a1-478a-8e6e-65881e15ce94 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.684844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db9c04-a8a1-478a-8e6e-65881e15ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.685117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db9c04-a8a1-478a-8e6e-65881e15ce94 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.685817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db9c04-a8a1-478a-8e6e-65881e15ce94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.688156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db9c04-a8a1-478a-8e6e-65881e15ce94 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.697407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 779/1545] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.699356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94478c-76cf-44dc-8d1e-88e34dbca589 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.699652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94478c-76cf-44dc-8d1e-88e34dbca589 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.700114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94478c-76cf-44dc-8d1e-88e34dbca589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.718302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 767/1546] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/users => generated 284 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:04.720039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdfc8a-b03e-4de4-af95-504935654c72 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.720606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdfc8a-b03e-4de4-af95-504935654c72 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.720984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdfc8a-b03e-4de4-af95-504935654c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.723509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dd94478c-76cf-44dc-8d1e-88e34dbca589 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.724744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd94478c-76cf-44dc-8d1e-88e34dbca589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.733174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 780/1547] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.735276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60ca4-1525-4c14-9df9-a8c3e5cda44e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.735568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60ca4-1525-4c14-9df9-a8c3e5cda44e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.735896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60ca4-1525-4c14-9df9-a8c3e5cda44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.741863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-87fdfc8a-b03e-4de4-af95-504935654c72 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.743179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-87fdfc8a-b03e-4de4-af95-504935654c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.752189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 768/1548] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.753466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ad87-6956-4598-b0fe-0818f5793b6f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.753756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ad87-6956-4598-b0fe-0818f5793b6f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.754034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ad87-6956-4598-b0fe-0818f5793b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.756442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ccd60ca4-1525-4c14-9df9-a8c3e5cda44e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.757727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ccd60ca4-1525-4c14-9df9-a8c3e5cda44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.766744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 781/1549] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.768117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43933d3-96f2-4a99-a214-34099095b6e7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.768406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43933d3-96f2-4a99-a214-34099095b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.768686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43933d3-96f2-4a99-a214-34099095b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.776536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7ec1ad87-6956-4598-b0fe-0818f5793b6f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.778069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7ec1ad87-6956-4598-b0fe-0818f5793b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.787292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 769/1550] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.787292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.787557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.787828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.792009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d43933d3-96f2-4a99-a214-34099095b6e7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.793201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d43933d3-96f2-4a99-a214-34099095b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.806973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 782/1551] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.806973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb16e6-c0d1-45f1-bc02-6927ef898d79 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.806973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb16e6-c0d1-45f1-bc02-6927ef898d79 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.806973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb16e6-c0d1-45f1-bc02-6927ef898d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.807394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.807581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.815820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 770/1552] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.816625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.826479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-58fb16e6-c0d1-45f1-bc02-6927ef898d79 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.827225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198f7a5-be5e-48b4-97f6-4ba22bf6a2cb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.828540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-58fb16e6-c0d1-45f1-bc02-6927ef898d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.832490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb291930-32f5-41b4-8b09-a17976599792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.833159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291930-32f5-41b4-8b09-a17976599792 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.833441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291930-32f5-41b4-8b09-a17976599792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.833715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291930-32f5-41b4-8b09-a17976599792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.834442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb291930-32f5-41b4-8b09-a17976599792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.836072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb291930-32f5-41b4-8b09-a17976599792 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.837033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 783/1553] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.842146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d8d44-192a-4baf-afe3-9a2c350435e1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.842146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d8d44-192a-4baf-afe3-9a2c350435e1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.842146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d8d44-192a-4baf-afe3-9a2c350435e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.853161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 771/1554] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:04.854591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427181af-809a-4374-970a-068c8023ff5e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.854984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427181af-809a-4374-970a-068c8023ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.855296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427181af-809a-4374-970a-068c8023ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.857584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5f7d8d44-192a-4baf-afe3-9a2c350435e1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.858776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5f7d8d44-192a-4baf-afe3-9a2c350435e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.866804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 784/1555] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.868056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.868341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.868614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.876735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-427181af-809a-4374-970a-068c8023ff5e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.878093 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-427181af-809a-4374-970a-068c8023ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.886442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 772/1556] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.887275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427181af-809a-4374-970a-068c8023ff5e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.889476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.890913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.897786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427181af-809a-4374-970a-068c8023ff5e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.899434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 785/1557] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.900258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.905720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.907160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.907444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.907740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.908476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:04.908785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.910488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f09e8-7d7a-4d13-9825-a1fd49782564 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.912944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bdf5d-accf-44ce-b8f1-ac7c49fde173 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.918114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.918785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.919069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.919344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.920130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:04.920438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.921459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:36:04.921459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:36:04.921459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:36:04.922416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02940afb-8646-4096-8d59-a032ce913b1c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.924151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 773/1558] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:04.925535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.926142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.926142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.936351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 786/1559] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:04.938069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.938356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.938629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.948052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.948551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.957612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 774/1560] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.958143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:04.958593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.959305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:04.967675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 787/1561] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:04.968490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.969967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ad311-33e8-40e8-bd21-bf6a8b6f97aa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.976806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.977605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.977920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.978221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.978367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360a34-e909-4170-8dc3-3032f7f7540e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:04.978997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.980659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.982945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:04.983654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:04.983923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:04.984199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:04.984999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:04.985306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:04.986887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:04.991768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 775/1562] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:04.996515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:04.998855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 788/1563] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:04.999670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.010218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3a720-a809-492e-81d5-a6820e090d8a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.011510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee46a5-1d56-4ccc-ad2c-0352031a3057 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.014786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.015432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.015812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.016090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.016501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.017060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:05.017205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.017363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.017500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.017779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.018505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:05.018817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.018953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.020436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.030880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 789/1564] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:05.032239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.039953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 776/1565] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:05.039953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.045360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3ca9-8d4b-4e56-8e3d-9b1ad9181db6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.050023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0efe6-2aea-414e-af55-57e3633b95a3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.050363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.051121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.051568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.051940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.052704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.054670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.054808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.055493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.055829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.056133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.056846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.057905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:36:05.057905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:36:05.057905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:36:05.059210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.082143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 790/1566] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.083276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.086501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 777/1567] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.087586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.104677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:05.111024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:05.153508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53d0a0-201f-4b21-bc8d-49664dff1c39 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.155410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14494017-2d60-439b-bb1c-4f7faa7424d3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.158286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.158957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.159241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.159520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.160228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.160368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:05.160614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.160894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.161178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.161461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.162188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:05.162303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.162495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.164154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.175178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 791/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:05.176156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 778/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:05.176270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.180626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.188595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c561-e8b2-49ca-8744-569dd54dae92 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.192039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251624e-22f0-4d05-b56f-9eaab381ad2e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.193580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.194471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.194754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.195034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] PATH_INFO: `/v3/projects/f3b879bbef5f4f15b57588aaa08433af/users/cdc68fa68e254c5c91efb270dd28fe06/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.196691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.197343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.197621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.197894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.198580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.200573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.210057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b879bbef5f4f15b57588aaa08433af, user_id=cdc68fa68e254c5c91efb270dd28fe06, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.212768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.226610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 792/1570] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:05 2022] PUT /identity/v3/projects/f3b879bbef5f4f15b57588aaa08433af/users/cdc68fa68e254c5c91efb270dd28fe06/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:05.227480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 779/1571] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.228141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.230628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.299694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acae2e-5f72-4a25-8d82-cd9b6fe69675 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.300776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d46fc-dc7d-4f3e-875e-1e47685ca20c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.304520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.305215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.305407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.305539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.305819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.306069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.306359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.306516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.306623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.307306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.308484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.309243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.335935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 780/1572] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.339480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.339625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 793/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.339625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.400803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcff19-0f57-4ab9-adb5-530144b13415 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.401821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c25c6e-b5f2-45d7-94b7-17c2e557e593 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.405523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.406234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.406413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.406527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.406787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.407075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.407366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.407486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.407631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.408337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.408514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:36:05.408514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:36:05.408514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:36:05.409721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.410212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.426660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:05.437309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 781/1574] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.437578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 794/1575] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.438190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.438282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.443201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63216b5-eeb1-4c39-8700-269caa478edc admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.444573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88524-fb13-491a-966c-7b3d2ac5a00a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.448111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a69b7d-75ad-4ffe-be44-d50678bea90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.448772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69b7d-75ad-4ffe-be44-d50678bea90b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.449059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69b7d-75ad-4ffe-be44-d50678bea90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.449339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69b7d-75ad-4ffe-be44-d50678bea90b admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.449857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.450029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a69b7d-75ad-4ffe-be44-d50678bea90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.450512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.450796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.451074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.451787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.452023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a69b7d-75ad-4ffe-be44-d50678bea90b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.453741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.455506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:05.480753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 795/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.485146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 782/1577] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.485314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.485453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.485453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.485453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.510543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] MFA Rules not processed for user `cdc68fa68e254c5c91efb270dd28fe06`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:05.511788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:05.547487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dce35-9082-461c-8f3f-9a9cae8e867c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.578098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 783/1578] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:05.578840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.612577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.613258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.613544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.613820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.614509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.616550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.638242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 796/1579] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.639265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.645399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0c79e-9466-46e4-9f2a-961e59d5b644 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.649408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49aaf-9f9d-49c5-a1c7-d78677cfd6f0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.650041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.650712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.650996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.651273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.651999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.653908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.654370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.655040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.655327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.655607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.656894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.658834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.675251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 784/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.675251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.685168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 797/1581] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.685168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.685718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10020-ad52-437e-a9b5-81c31508a901 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.690776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.691438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.691750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.692029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.692758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.693933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40282d-35a7-4757-b9bd-37aac38cc85d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.694346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.698736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.699403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.699859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.700144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.700877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.702476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.705707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 785/1582] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.706493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.713689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 798/1583] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.714428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.716575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175530f6-94e0-4fc8-a1dc-87b230e1a0b4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.721760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.722420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.722706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.722981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.723668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.724803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b4bb9-0d5c-42d6-8cc8-318d83d3bfbd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.725633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.729465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.730125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.730410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.730687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.731366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.733321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.746831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 786/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.747848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.758104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 799/1585] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:05 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:05.758935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.770595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7f37-626e-4bb4-a901-5c19153d0f64 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.775893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.776595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.776877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.777151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.777914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.779515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.789754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:05.790249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 800/1586] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.791054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.800839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca93f9-ff54-4a41-a935-06b1346e8c41 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.805924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.806610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.806913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.807173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.807997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.809578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.810067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b881c52-ea8d-4d68-8663-b27cde9aa706 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.814542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.815202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.815489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.815795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.822600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 801/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.823452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.825687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.827201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.837992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 787/1588] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:05.838141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f95938-3c81-4439-acae-37fd1645f496 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.838780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.842679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.843353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.843685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.844076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.845168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.847683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.849512 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bfe09-6a5b-4765-9198-2ddcbfa1eab4 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.849761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:05.854978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.855706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.856016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.856397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.857154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.858779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.868038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 802/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.869213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.869953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 788/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.870797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.883327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d8d5-02a9-443f-bd29-6e26b01c804e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.883541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cf0f0-3d24-410e-9340-3b9b3c4a47ad admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.888696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.888980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.889685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.889973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.890253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.890606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.891871 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.892288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.892624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.893561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.893938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.895610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.909227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 789/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.909227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.909835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 803/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.910683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.919191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29bc08-b037-4aa6-9506-e56e3f83ac12 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.922920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82649-c25b-4bc9-ac61-0e1d31c068dd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.924391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.925171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.925408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.925844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.926586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.928055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.928203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.928732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.929017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.929472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.930293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.932124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.944367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 790/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.944367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.944623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 804/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.945321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.953701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5235-5cac-47ca-8541-9fce3b68ea28 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.957029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21311bc-a565-4998-8d96-2eaaed7997e7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.958449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.959096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.959409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.959711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.960677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.961754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.962297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.962411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.962684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.962960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.963690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.965409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.974143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 791/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.976291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.976424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 805/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:05.977215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:05.988891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2cf0f-e98e-40e5-a4f9-e3ca95e0df3b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.991706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d62c8-e462-49f7-a89b-2f636d408a91 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:05.993962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:05.994736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:05.995067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:05.995314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:05.996308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:05.998059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:05.999124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.000930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.001567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.001567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] PATH_INFO: `/v3/projects/2c6eb750eb17435daef4cc8cb2f53103/users/4247e1dc34ef44c5b933e105d170911d/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.010632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 806/1597] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:06.011540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.022470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6eb750eb17435daef4cc8cb2f53103, user_id=4247e1dc34ef44c5b933e105d170911d, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.023541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de991-289d-4a7b-ae8c-a7cf137634e0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.023740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:36:06.023740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:36:06.023740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:36:06.025735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.029180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.030250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.032084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.032084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] PATH_INFO: `/v3/projects/1629e2ef448c4dd9883264a4a310df5e/users/2c6ad0ad11944b81accd2f70a322d176/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.043391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 792/1598] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:05 2022] PUT /identity/v3/projects/2c6eb750eb17435daef4cc8cb2f53103/users/4247e1dc34ef44c5b933e105d170911d/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.045025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.058780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1629e2ef448c4dd9883264a4a310df5e, user_id=2c6ad0ad11944b81accd2f70a322d176, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.061680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.079775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 807/1599] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:06 2022] PUT /identity/v3/projects/1629e2ef448c4dd9883264a4a310df5e/users/2c6ad0ad11944b81accd2f70a322d176/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.079775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.118892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd1dd-3298-4f6b-9754-ee24fc58b900 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.151406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e9bdf-15cb-4774-82ee-a18ef9ddadf3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.158245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.159339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.159631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.160010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] PATH_INFO: `/v3/projects/641b840d07634361a1780099fddf24de/users/cddf62fa4ca944cabb9d3b91f38fde62/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.180620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=641b840d07634361a1780099fddf24de, user_id=cddf62fa4ca944cabb9d3b91f38fde62, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.183370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.195237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.196520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.197075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.197485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.198635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.200402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.206792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 808/1600] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:06 2022] PUT /identity/v3/projects/641b840d07634361a1780099fddf24de/users/cddf62fa4ca944cabb9d3b91f38fde62/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.206792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.218777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 793/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:06.218777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.228968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d1d19-fa66-43b1-84a5-e1614a9fda03 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.238898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:06.285583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216c0b9-ec4d-414a-a2a3-b0f7881565fc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.290584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.291737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.292200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.292456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] PATH_INFO: `/v3/projects/a6ad11865dd34796ae914c5a384d1b68/users/c9cefbfcc418450f8a1d680fca6e1bd0/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.297375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f5e88-c370-4f1a-a67a-4568440a2e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.298436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5e88-c370-4f1a-a67a-4568440a2e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.298762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5e88-c370-4f1a-a67a-4568440a2e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.298959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f5e88-c370-4f1a-a67a-4568440a2e76 admin admin] PATH_INFO: `/v3/projects/f5dd328ca98243798776889749e2a8eb/users/3e9653f2408549da853449559ec820b0/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.310731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ad11865dd34796ae914c5a384d1b68, user_id=c9cefbfcc418450f8a1d680fca6e1bd0, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.314269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.316547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f5e88-c370-4f1a-a67a-4568440a2e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd328ca98243798776889749e2a8eb, user_id=3e9653f2408549da853449559ec820b0, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.317000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:06.320137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f5e88-c370-4f1a-a67a-4568440a2e76 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.332151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 809/1602] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:06 2022] PUT /identity/v3/projects/a6ad11865dd34796ae914c5a384d1b68/users/c9cefbfcc418450f8a1d680fca6e1bd0/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.334908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 794/1603] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:06 2022] PUT /identity/v3/projects/f5dd328ca98243798776889749e2a8eb/users/3e9653f2408549da853449559ec820b0/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.336142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6431-32bf-435b-b263-57114b38242a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.336470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6431-32bf-435b-b263-57114b38242a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.336688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6431-32bf-435b-b263-57114b38242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.337160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.357615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-efbd6431-32bf-435b-b263-57114b38242a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.358818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-efbd6431-32bf-435b-b263-57114b38242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.435526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa05c7-c403-41bc-bad6-d9a44634694a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.440969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 795/1604] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.441968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.442309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d86f-f07a-467b-851c-2cb6cd35581d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.442702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d86f-f07a-467b-851c-2cb6cd35581d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.443021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.443148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5d86f-f07a-467b-851c-2cb6cd35581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.443306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.443583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] PATH_INFO: `/v3/projects/462609931a914181aad0c36e472c5b6e/users/49c04300608b4e3aa01890e553a82aec/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.465337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-56e5d86f-f07a-467b-851c-2cb6cd35581d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.466846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-56e5d86f-f07a-467b-851c-2cb6cd35581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.471629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] RBAC: Authorizing `identity:create_grant(project_id=462609931a914181aad0c36e472c5b6e, user_id=49c04300608b4e3aa01890e553a82aec, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.475288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.478499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 796/1605] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.480369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486981c-450c-4bfd-a6b4-d749c575c33b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.480909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486981c-450c-4bfd-a6b4-d749c575c33b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.481281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486981c-450c-4bfd-a6b4-d749c575c33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.508633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 810/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:06 2022] PUT /identity/v3/projects/462609931a914181aad0c36e472c5b6e/users/49c04300608b4e3aa01890e553a82aec/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.508633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.517491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5486981c-450c-4bfd-a6b4-d749c575c33b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.518756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5486981c-450c-4bfd-a6b4-d749c575c33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.568030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea9823-2266-4bd7-9362-0158b092511e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.575417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba883e2-d090-44ee-955d-8b4a036a1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.576439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba883e2-d090-44ee-955d-8b4a036a1475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.576760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba883e2-d090-44ee-955d-8b4a036a1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.577087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba883e2-d090-44ee-955d-8b4a036a1475 admin admin] PATH_INFO: `/v3/projects/c9aa7b79d697427e8a6b3edcb2ccbd61/users/522718a05dfe48f291a687006be5d014/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.589763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 797/1607] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.590975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.591349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.591745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.594843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba883e2-d090-44ee-955d-8b4a036a1475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aa7b79d697427e8a6b3edcb2ccbd61, user_id=522718a05dfe48f291a687006be5d014, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.597587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba883e2-d090-44ee-955d-8b4a036a1475 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.612064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.613303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.614171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 811/1608] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:06 2022] PUT /identity/v3/projects/c9aa7b79d697427e8a6b3edcb2ccbd61/users/522718a05dfe48f291a687006be5d014/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:06.619561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.619561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.619561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.644639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:06.651646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] MFA Rules not processed for user `c9cefbfcc418450f8a1d680fca6e1bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.652984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.682488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 798/1609] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.683419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.704198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:06.724883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 812/1610] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.726003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.727411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.742151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b755ec-767c-49b0-8448-86b7d0a702b1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.746627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335468-ec0c-4fde-b107-28b0b2089fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.747994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335468-ec0c-4fde-b107-28b0b2089fda service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.747994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335468-ec0c-4fde-b107-28b0b2089fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.748212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335468-ec0c-4fde-b107-28b0b2089fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.759241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5335468-ec0c-4fde-b107-28b0b2089fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.761598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5335468-ec0c-4fde-b107-28b0b2089fda service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.775378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 799/1611] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:06.776803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.777106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.777387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.794533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85310a-41ab-4eec-990d-68209b3e6d90 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.800644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.801621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.801960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.802240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.806351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] MFA Rules not processed for user `49c04300608b4e3aa01890e553a82aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.807542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.815745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.817490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.836851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 813/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:06.837517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.846743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de27d-b4ae-4a6f-a931-08375bfa497f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.851102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61f7e8-1a15-40bb-9399-32822ba793de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.851893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f7e8-1a15-40bb-9399-32822ba793de service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.852288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f7e8-1a15-40bb-9399-32822ba793de service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.852670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f7e8-1a15-40bb-9399-32822ba793de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.864675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61f7e8-1a15-40bb-9399-32822ba793de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.866644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61f7e8-1a15-40bb-9399-32822ba793de service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.880259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 814/1613] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:06.882766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d903-c5be-43ed-96c7-0d88b0c84f73 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.883196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d903-c5be-43ed-96c7-0d88b0c84f73 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.883586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d903-c5be-43ed-96c7-0d88b0c84f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.903976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8a52d903-c5be-43ed-96c7-0d88b0c84f73 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:06.905471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8a52d903-c5be-43ed-96c7-0d88b0c84f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:06.907065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 800/1614] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.908148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.919328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 815/1615] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:06.921044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472c90a-7848-4356-ab37-ef705811b572 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.921488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472c90a-7848-4356-ab37-ef705811b572 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.921977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472c90a-7848-4356-ab37-ef705811b572 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.924400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 816/1616] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 20 09:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:06.925243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472c90a-7848-4356-ab37-ef705811b572 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:06.925362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11616f6-945d-4109-8699-2409a65466e7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.930419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d3ab7-a16e-43c3-a293-6fcfc0800862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.931130 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3ab7-a16e-43c3-a293-6fcfc0800862 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.931573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3ab7-a16e-43c3-a293-6fcfc0800862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.931937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3ab7-a16e-43c3-a293-6fcfc0800862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.954821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472c90a-7848-4356-ab37-ef705811b572 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:06.960881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d3ab7-a16e-43c3-a293-6fcfc0800862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.961351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:06.962270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.962405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d3ab7-a16e-43c3-a293-6fcfc0800862 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.963191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.963440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:06.964758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:06.967083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:06.979248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 801/1617] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:06.981209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:06.981906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:06.982203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.004733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 817/1618] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:07.006139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.045600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:07.047927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:07.084111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992ad3d-2b05-44ef-8564-a606415bd08e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.089279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.090197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.090627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.091039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.106902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:07.179256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 802/1619] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 20 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:07.180617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.203979 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.206438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.214170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:07.226806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 818/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:07.229676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.247308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9580b-8523-4e8e-a067-b7f072a2641b service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.255409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.256262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.256632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.256795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.304226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4ac5a-42a9-4174-aed6-b4ded0ad5420 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.314645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.315450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.317220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.317816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.321116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.341818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.355253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.357060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.377302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 819/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:07.418604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 803/1622] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:07 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:07.423619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.443929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c6c95-04e9-4285-bfea-e25d8571e028 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.462086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.463035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.465740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.466454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.469737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.476682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.502964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 820/1623] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:07.503994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.516971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada4fa-de9e-4126-995c-0caa7bd1a730 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.526153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.527179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.527496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.528840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] PATH_INFO: `/v3/projects/1759432e8a694e6786c7ae161380c157/users/e22f8b56edae4d4bbd8fb0b2a7326e8a/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.559829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1759432e8a694e6786c7ae161380c157, user_id=e22f8b56edae4d4bbd8fb0b2a7326e8a, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.565982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.591310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 804/1624] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:07 2022] PUT /identity/v3/projects/1759432e8a694e6786c7ae161380c157/users/e22f8b56edae4d4bbd8fb0b2a7326e8a/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:07.596008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.612064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042ef6d-4d5e-42cd-8ea4-5b96da810028 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.750830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115dbcf-630c-4565-bd44-9224afa2c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.751532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115dbcf-630c-4565-bd44-9224afa2c91c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.751883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115dbcf-630c-4565-bd44-9224afa2c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.752169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115dbcf-630c-4565-bd44-9224afa2c91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.754561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115dbcf-630c-4565-bd44-9224afa2c91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.757247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115dbcf-630c-4565-bd44-9224afa2c91c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.776261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 821/1625] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:07.780073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:07.794665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2eec-95c3-46a0-b806-f4a2042da089 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:07.804752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80587ed-7e2e-4b0c-86be-89dc180e7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:07.804752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80587ed-7e2e-4b0c-86be-89dc180e7273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.804752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80587ed-7e2e-4b0c-86be-89dc180e7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.804752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80587ed-7e2e-4b0c-86be-89dc180e7273 admin admin] PATH_INFO: `/v3/projects/1759432e8a694e6786c7ae161380c157/users/e22f8b56edae4d4bbd8fb0b2a7326e8a/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.808171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80587ed-7e2e-4b0c-86be-89dc180e7273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1759432e8a694e6786c7ae161380c157, user_id=e22f8b56edae4d4bbd8fb0b2a7326e8a, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:07.811610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80587ed-7e2e-4b0c-86be-89dc180e7273 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:07.826434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 805/1626] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:07 2022] PUT /identity/v3/projects/1759432e8a694e6786c7ae161380c157/users/e22f8b56edae4d4bbd8fb0b2a7326e8a/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:07.837471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb891a9-0ba1-4c61-a5d5-6755feb4e6cb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.837791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb891a9-0ba1-4c61-a5d5-6755feb4e6cb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.838045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb891a9-0ba1-4c61-a5d5-6755feb4e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.873634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0fb891a9-0ba1-4c61-a5d5-6755feb4e6cb None None] MFA Rules not processed for user `e22f8b56edae4d4bbd8fb0b2a7326e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:07.874952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0fb891a9-0ba1-4c61-a5d5-6755feb4e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:07.882958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576172-79ec-4c7e-9918-484079d6c7f3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.883317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576172-79ec-4c7e-9918-484079d6c7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.883525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576172-79ec-4c7e-9918-484079d6c7f3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.885274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 806/1627] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 20 09:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:07.893876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aced3d-d77a-485f-b879-56442c04346a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:07.894228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aced3d-d77a-485f-b879-56442c04346a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:07.894488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aced3d-d77a-485f-b879-56442c04346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:07.932946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a7aced3d-d77a-485f-b879-56442c04346a None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:07.934183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a7aced3d-d77a-485f-b879-56442c04346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:08.048331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 822/1628] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:08.052021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036d58-2ac8-4bb1-bc8d-19728468e1bc None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.052021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036d58-2ac8-4bb1-bc8d-19728468e1bc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.052326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036d58-2ac8-4bb1-bc8d-19728468e1bc None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.053622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 823/1629] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 20 09:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:08.057595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1036d58-2ac8-4bb1-bc8d-19728468e1bc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:08.085786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:08.119552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 807/1630] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:36:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:08.124068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e47de-62f3-452f-a458-80562f063227 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.124414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e47de-62f3-452f-a458-80562f063227 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.125004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e47de-62f3-452f-a458-80562f063227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.150169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1036d58-2ac8-4bb1-bc8d-19728468e1bc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:08.154496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:08.155306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.155640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.156580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.168707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:08.171015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:08.198139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 824/1631] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:08.200375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:08.206847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c27e47de-62f3-452f-a458-80562f063227 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:08.208322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c27e47de-62f3-452f-a458-80562f063227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:08.221461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 808/1632] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 20 09:36:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:08.225000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefe2dd-cf33-4546-a54d-de128e4f5d7b service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:08.228272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2aa2a-7e88-4360-82d0-be0b6c72058c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.228778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2aa2a-7e88-4360-82d0-be0b6c72058c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.229561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2aa2a-7e88-4360-82d0-be0b6c72058c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.233324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 809/1633] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 20 09:36:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:08.238270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.238560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.239038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:08.239757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.240132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.241661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.241957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.255709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:08.274349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:08.274938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:08.276005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:08.279105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:08.289732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 810/1634] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:36:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:08.311918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 825/1635] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:08.354417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:08.364886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252d1f9-a5da-4530-adb6-0e6acea8673c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:08.369152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:08.370063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.370484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.370949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.402734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:08.404251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:08.442427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 811/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:08.541393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:08.559296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e4f9d-acfc-4fca-a190-47dd4ae2b3a7 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:08.581909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40641f-ff6d-48e9-ad89-066dd459f900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:08.583372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40641f-ff6d-48e9-ad89-066dd459f900 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:08.583666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40641f-ff6d-48e9-ad89-066dd459f900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:08.583984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40641f-ff6d-48e9-ad89-066dd459f900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:08.721774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40641f-ff6d-48e9-ad89-066dd459f900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:08.723987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40641f-ff6d-48e9-ad89-066dd459f900 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:08.746691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 826/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:13.367299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:13.535993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980dc89-0889-4109-8a39-f93752987394 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:13.559104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:13.560071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:13.560357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:13.560635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] PATH_INFO: `/v3/users/c9cefbfcc418450f8a1d680fca6e1bd0` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:13.563920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cefbfcc418450f8a1d680fca6e1bd0)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:13.565031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:36:13.565031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: warnings.warn(msg) Jul 20 09:36:13.565031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: Jul 20 09:36:13.566262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:13.743916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cefbfcc418450f8a1d680fca6e1bd0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:13.758868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cefbfcc418450f8a1d680fca6e1bd0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:13.843930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cefbfcc418450f8a1d680fca6e1bd0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:13.846425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cefbfcc418450f8a1d680fca6e1bd0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:13.869489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cefbfcc418450f8a1d680fca6e1bd0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:13.887627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 812/1638] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:13 2022] DELETE /identity/v3/users/c9cefbfcc418450f8a1d680fca6e1bd0 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:13.892605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:13.893339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:13.893339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:13.943243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:13.944535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:14.184251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 827/1639] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:14.222005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:14.224384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:14.453451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551fae5-9f18-4437-b5a2-de5cf9525664 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:14.470526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eed50d-825d-4478-8e59-8309346a802a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:14.471526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eed50d-825d-4478-8e59-8309346a802a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:14.472042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eed50d-825d-4478-8e59-8309346a802a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:14.472491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eed50d-825d-4478-8e59-8309346a802a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:14.507987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eed50d-825d-4478-8e59-8309346a802a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:14.509717 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eed50d-825d-4478-8e59-8309346a802a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:14.545604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 813/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:16.070577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:16.072539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:16.121751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3d7e-134f-4c20-ac78-a52ed3249dbf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:16.141865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:16.148712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:16.149020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:16.149312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] PATH_INFO: `/v3/projects/a6ad11865dd34796ae914c5a384d1b68` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:16.160612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ad11865dd34796ae914c5a384d1b68)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:16.170542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:36:16.170542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 20 09:36:16.170542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: Jul 20 09:36:16.176559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:16.328683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:16.384114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ad11865dd34796ae914c5a384d1b68', 'request_id': 'req-55f78b60-2c28-4cba-9601-b66574ae8fa8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:16.401506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ad11865dd34796ae914c5a384d1b68', 'request_id': 'req-55f78b60-2c28-4cba-9601-b66574ae8fa8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:16.427478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ad11865dd34796ae914c5a384d1b68', 'request_id': 'req-55f78b60-2c28-4cba-9601-b66574ae8fa8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:16.475671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] The token cache is being invalidate because project a6ad11865dd34796ae914c5a384d1b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:16.475997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:16.478469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:16.482543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 828/1641] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:16 2022] DELETE /identity/v3/projects/a6ad11865dd34796ae914c5a384d1b68 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:16.487818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aa039-83a6-4539-885c-6943fe921773 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:16.488275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aa039-83a6-4539-885c-6943fe921773 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:16.488377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304aa039-83a6-4539-885c-6943fe921773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:16.530788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-304aa039-83a6-4539-885c-6943fe921773 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:16.533626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-304aa039-83a6-4539-885c-6943fe921773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:16.544274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:16.591243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:16.592838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:16.783167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 814/1642] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:16.784772 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:16.785076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:16.785360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:16.845204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f78b60-2c28-4cba-9601-b66574ae8fa8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:16.853373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:16.853373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:16.855224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:16.858137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:16.858137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:16.858137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] PATH_INFO: `/v3/users/49c04300608b4e3aa01890e553a82aec` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:16.865846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c04300608b4e3aa01890e553a82aec)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:16.872405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:16.891877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 815/1643] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:16.893374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:16.916735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7638c0-f170-4f9a-ab6d-73bafbc509e9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:16.923335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:16.924059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:16.924345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:16.924677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:16.925501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:16.925866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:16.928521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:16.972994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 816/1644] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:16.973993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:16.998829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f6d52-ad60-4927-9875-9c96e6ae6b53 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:16.999304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c04300608b4e3aa01890e553a82aec'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:17.018239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c04300608b4e3aa01890e553a82aec'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:17.020502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:17.021256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.021544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.021823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.022529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:17.025325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:17.047643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c04300608b4e3aa01890e553a82aec'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:17.051043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c04300608b4e3aa01890e553a82aec'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:17.066186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5c3b0410-8032-4232-8323-623c668e4408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c04300608b4e3aa01890e553a82aec'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:17.082289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 829/1645] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:16 2022] DELETE /identity/v3/users/49c04300608b4e3aa01890e553a82aec => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:17.093455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.093784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.094197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.098014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 817/1646] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:16 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:17.102851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:17.104640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:17.138500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:17.146190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:17.232977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:17.278496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be271ab2-414c-4d6e-a2c3-abbf548d0d8a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:17.297433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:17.298146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.298434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.298713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.299463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:17.304482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 830/1647] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:17.315981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:17.327062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:17.333502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:17.382152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 818/1648] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:17 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:17.387068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:17.409165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00fe0-e7e4-40f8-85c5-5f35bcf26c56 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:17.421975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:17.423071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.423206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.423404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.424254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:17.426170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:17.455518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 819/1649] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:17.459173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:17.479220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404a1ae-74c8-408b-84d6-5de495728004 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:17.494319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:17.495101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.495585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.495585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.496336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:17.506713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:17.530152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 820/1650] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:17.532125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:17.533427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8643-8af3-437e-a93e-93a5975e3408 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:17.544650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3032-7b1a-485c-ac5a-2b6066ff9f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:17.547581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3032-7b1a-485c-ac5a-2b6066ff9f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.548317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3032-7b1a-485c-ac5a-2b6066ff9f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.548831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3032-7b1a-485c-ac5a-2b6066ff9f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.569617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b441-99ab-4448-94aa-9c45bbb646de admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:17.574893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d3032-7b1a-485c-ac5a-2b6066ff9f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:17.579139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d3032-7b1a-485c-ac5a-2b6066ff9f06 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:17.585422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:17.586350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.586634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.586909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] PATH_INFO: `/v3/projects/d60a74104bf1414c99bbe20e7dc27c41/users/1d9bc684c21a465aa8cc699ef728e011/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.616759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 831/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:17.656041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60a74104bf1414c99bbe20e7dc27c41, user_id=1d9bc684c21a465aa8cc699ef728e011, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:17.658769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:17.700305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 821/1652] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:17 2022] PUT /identity/v3/projects/d60a74104bf1414c99bbe20e7dc27c41/users/1d9bc684c21a465aa8cc699ef728e011/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:17.702307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:17.702818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:17.703196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:17.783999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] MFA Rules not processed for user `1d9bc684c21a465aa8cc699ef728e011`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:17.788635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:18.022639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 832/1653] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:18.026755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:18.056212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:18.215049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958ef3a-e832-4536-8a7f-164164bcda43 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:18.231806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:18.233026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:18.234358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:18.234994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:18.236086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:18.240271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:18.306296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 822/1654] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:18 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:18.310043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:18.329303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfbab7-ba87-446e-8406-e3b5e513de85 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:18.481298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:18.482146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:18.482536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:18.482908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:18.483742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:18.486397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:18.558965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 833/1655] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:18 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:18.560483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:18.565733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:18.567846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:18.584354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:18.588165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeffdc8-d864-4550-994f-96cea9e86f3c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:18.594829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11543-9d1d-4ba7-9b37-032560511c21 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:18.608014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:18.608973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:18.609258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:18.609657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] PATH_INFO: `/v3/users/cdc68fa68e254c5c91efb270dd28fe06` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:18.618184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc68fa68e254c5c91efb270dd28fe06)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:18.618530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:18.619424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:18.619784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:18.620163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:18.620281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:18.621180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:18.622930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:18.661741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 823/1656] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:36:18.670692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:18.691400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0d74-0185-4110-8b19-945a2ebdd7ef admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:18.704641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:18.705818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:18.706213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:18.711049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] PATH_INFO: `/v3/projects/538e6ee8b71846458c48a3f2a85c94cb/users/34c49f22ac764f718375b0696a9bf3e7/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:18.748335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc68fa68e254c5c91efb270dd28fe06'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:18.752064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=538e6ee8b71846458c48a3f2a85c94cb, user_id=34c49f22ac764f718375b0696a9bf3e7, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:18.757800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:18.762792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc68fa68e254c5c91efb270dd28fe06'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:18.784853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 824/1657] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:18 2022] PUT /identity/v3/projects/538e6ee8b71846458c48a3f2a85c94cb/users/34c49f22ac764f718375b0696a9bf3e7/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:18.788617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:18.810697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc68fa68e254c5c91efb270dd28fe06'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:18.813836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc68fa68e254c5c91efb270dd28fe06'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:18.838187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e859f84-a950-4751-ae94-d97ad6e997a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc68fa68e254c5c91efb270dd28fe06'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:18.855505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 834/1658] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:18 2022] DELETE /identity/v3/users/cdc68fa68e254c5c91efb270dd28fe06 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:18.860465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc109-88a2-422e-93fc-60d870c62fa1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:18.860754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc109-88a2-422e-93fc-60d870c62fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:18.861038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc109-88a2-422e-93fc-60d870c62fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:18.900132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2e5fc109-88a2-422e-93fc-60d870c62fa1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:18.901514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2e5fc109-88a2-422e-93fc-60d870c62fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:18.959683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9046-8f6f-470c-b9d5-cd308081e61b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:19.072609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 835/1659] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:19.076025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.076025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.076025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.118455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:19.119254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.119536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.119840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.120588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:19.124013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:19.133898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] MFA Rules not processed for user `2c6ad0ad11944b81accd2f70a322d176`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:19.135849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:19.145400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 825/1660] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:19.146276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:19.159383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:19.179450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:19.289609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fa27b-4f63-4f38-8d1b-67a6635e16de admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:19.296754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 836/1661] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:19.297599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:19.298699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:19.299693 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.300058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.300330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.302392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:19.336454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:19.338025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:19.344624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:19.350583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648970b1-0497-4d03-a3fc-7bc12bb0c42f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:19.367386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 826/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:19.367574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac636ec-f13f-44c7-a63a-808186ad7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:19.368583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:19.368693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac636ec-f13f-44c7-a63a-808186ad7e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.369021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac636ec-f13f-44c7-a63a-808186ad7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.369363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac636ec-f13f-44c7-a63a-808186ad7e4c admin admin] PATH_INFO: `/v3/projects/538e6ee8b71846458c48a3f2a85c94cb/users/34c49f22ac764f718375b0696a9bf3e7/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.374240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac636ec-f13f-44c7-a63a-808186ad7e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=538e6ee8b71846458c48a3f2a85c94cb, user_id=34c49f22ac764f718375b0696a9bf3e7, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:19.375010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:19.377608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac636ec-f13f-44c7-a63a-808186ad7e4c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:19.417732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 837/1663] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:19 2022] PUT /identity/v3/projects/538e6ee8b71846458c48a3f2a85c94cb/users/34c49f22ac764f718375b0696a9bf3e7/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:19.419689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.419998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.420284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.480696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] MFA Rules not processed for user `34c49f22ac764f718375b0696a9bf3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:19.481989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:19.572595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc898ef-bb09-4708-ba18-6f434c28d8f8 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:19.718546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 838/1664] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:19.731239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:19.735546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:19.736270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.736674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.736964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.737797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:19.854191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb2142-db07-4757-be6a-0b46ea1f0ed4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:19.860880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:19.861588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:19.861875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:19.864164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:19.864337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:19.906115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:19.908317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:19.908549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:19.910019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:19.936508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 827/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:19.943298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 839/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:19.996850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:20.133754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:20.136214 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:20.143504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfa9a-49d7-4f65-b6f7-5f419447ecd3 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:20.156999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:20.157988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.158277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.158549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] PATH_INFO: `/v3/users/1d9bc684c21a465aa8cc699ef728e011` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.161241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9bc684c21a465aa8cc699ef728e011)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:20.163332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:20.189098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bd28c-967a-46b9-a7a3-781f56855df0 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:20.202696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:20.209016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.210026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.210424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] PATH_INFO: `/v3/projects/f3b879bbef5f4f15b57588aaa08433af` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.212121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b879bbef5f4f15b57588aaa08433af)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:20.214306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:20.337175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9bc684c21a465aa8cc699ef728e011'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.350790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9bc684c21a465aa8cc699ef728e011'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.376505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9bc684c21a465aa8cc699ef728e011'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.377234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9bc684c21a465aa8cc699ef728e011'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.414051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c313e65e-325b-4506-a5d5-2c64ee43d706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9bc684c21a465aa8cc699ef728e011'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.433522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 828/1667] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:19 2022] DELETE /identity/v3/users/1d9bc684c21a465aa8cc699ef728e011 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:20.436667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.436966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.437251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.439606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b879bbef5f4f15b57588aaa08433af', 'request_id': 'req-e4b8bb9d-3d08-42da-b833-437e98908576'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.455706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b879bbef5f4f15b57588aaa08433af', 'request_id': 'req-e4b8bb9d-3d08-42da-b833-437e98908576'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.469627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b879bbef5f4f15b57588aaa08433af', 'request_id': 'req-e4b8bb9d-3d08-42da-b833-437e98908576'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.503392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:20.507417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:20.508693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] The token cache is being invalidate because project f3b879bbef5f4f15b57588aaa08433af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:20.509112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.511331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4b8bb9d-3d08-42da-b833-437e98908576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:20.524000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 840/1668] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:20 2022] DELETE /identity/v3/projects/f3b879bbef5f4f15b57588aaa08433af => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:20.530093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42cf95-4016-40b6-a2b8-64f576a5f001 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.530603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42cf95-4016-40b6-a2b8-64f576a5f001 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.531034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42cf95-4016-40b6-a2b8-64f576a5f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.547222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:20.587446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce42cf95-4016-40b6-a2b8-64f576a5f001 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:20.591289 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce42cf95-4016-40b6-a2b8-64f576a5f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:20.643334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 829/1669] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:20.720585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:20.723778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:20.737455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:20.773447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 841/1670] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:20.780518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.780925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.781223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.856546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:20.859693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:20.872651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdba36-db7b-4c51-ad76-999c207d8c86 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:20.890658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:20.892134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.892423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.892694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.899924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 842/1671] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:20.901247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:20.910966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:20.912647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:20.925103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c14f9-b7ba-4c98-ac54-d4263dacd90e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:20.925665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 830/1672] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:36:20.936755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:20.940135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:20.940442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:20.940733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:20.943632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:20.944047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:20.948261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:20.972666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:20.974706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:20.986344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 843/1673] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:20.988370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:20.998322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647015a3-c3a6-474c-b265-885350b4a7b3 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.012640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e40ab-5bfe-40ea-95e9-cf7c0146ea09 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.017549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.019109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.019705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.020521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] PATH_INFO: `/v3/projects/462609931a914181aad0c36e472c5b6e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.023612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=462609931a914181aad0c36e472c5b6e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.026451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.027305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.027662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.027792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.028041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.028753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.036340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.107452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 844/1674] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:20 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:21.112719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:21.122514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462609931a914181aad0c36e472c5b6e', 'request_id': 'req-76d95bfe-9f16-4897-9407-0c87cfaccb1c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.137844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462609931a914181aad0c36e472c5b6e', 'request_id': 'req-76d95bfe-9f16-4897-9407-0c87cfaccb1c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.146516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462609931a914181aad0c36e472c5b6e', 'request_id': 'req-76d95bfe-9f16-4897-9407-0c87cfaccb1c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.163853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] The token cache is being invalidate because project 462609931a914181aad0c36e472c5b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:21.164342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.167012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.169683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 831/1675] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:20 2022] DELETE /identity/v3/projects/462609931a914181aad0c36e472c5b6e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:21.174879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:21.178617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:21.298172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93db741-45c0-4f65-a266-85096bac92e6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.322384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.325980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.327992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.330021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.330774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.336196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.382177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95bfe-9f16-4897-9407-0c87cfaccb1c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.410966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 845/1676] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:21 2022] POST /identity/v3/users => generated 303 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:21.414819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:21.434509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:21.437065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.438102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.438263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.445114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] PATH_INFO: `/v3/users/e22f8b56edae4d4bbd8fb0b2a7326e8a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.449450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22f8b56edae4d4bbd8fb0b2a7326e8a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.458077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.478851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da518-5cf6-4adc-bca1-b26bf437676d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.495821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.499777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.502851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.503162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.504872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.511995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.551113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 846/1677] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:21.552254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:21.575864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:21.577311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b1daf-0fc8-41f5-9ed7-e38546265818 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.592117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.593311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.593893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.594703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.596119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.598001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.613434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 847/1678] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:21.619943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:21.630373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22f8b56edae4d4bbd8fb0b2a7326e8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.633956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fa370-d323-4640-ab9c-2c38651cba77 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:21.640723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:21.642421 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.642957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.643440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] PATH_INFO: `/v3/projects/e6e12f72e65e43368a31b2faff28f28b/users/becfa896d92b4a94a6b2b946cc656ee8/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.651398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22f8b56edae4d4bbd8fb0b2a7326e8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.691753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22f8b56edae4d4bbd8fb0b2a7326e8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.692264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e12f72e65e43368a31b2faff28f28b, user_id=becfa896d92b4a94a6b2b946cc656ee8, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:21.693196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22f8b56edae4d4bbd8fb0b2a7326e8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.695435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:21.725068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a18b3891-9726-41d3-8c4b-703cd7906ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22f8b56edae4d4bbd8fb0b2a7326e8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:21.747133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 832/1679] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:21 2022] DELETE /identity/v3/users/e22f8b56edae4d4bbd8fb0b2a7326e8a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:21.747676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 848/1680] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:21 2022] PUT /identity/v3/projects/e6e12f72e65e43368a31b2faff28f28b/users/becfa896d92b4a94a6b2b946cc656ee8/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:21.759901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:21.760196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:21.760577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:21.807445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] MFA Rules not processed for user `becfa896d92b4a94a6b2b946cc656ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:21.810275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:21.957437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 833/1681] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:21.958378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:21.960208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:21.986970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:22.099004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58413-1ad5-4536-a4e8-edcdb74dab38 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:22.210451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:22.211567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.211982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.212366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:22.215083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:22.220051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:22.295073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:22.295560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 849/1682] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:21 2022] POST /identity/v3/projects => generated 401 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:22.328352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590fe4-1cd2-491c-ac81-89157b296fcd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:22.451016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:22.451980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.452102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.452332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:22.453175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:22.455456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:22.496108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 834/1683] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:22 2022] POST /identity/v3/users => generated 307 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:22.500450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:22.519279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839a52-51a4-4edb-b7c4-4cdc447fb9e6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:22.529734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:22.531549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.531916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.532203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:22.538066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:22.539868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:22.562188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:22.575559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6ae5-46f0-472a-9cdf-92cd129c98de admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:22.576504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 850/1684] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:22.583579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:22.584564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.584855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.585137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] PATH_INFO: `/v3/projects/f4ccd4ccd923488cbee14d3c67611e13/users/4273090d8f6e476fa85d422b7e208bda/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:22.606292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ccd4ccd923488cbee14d3c67611e13, user_id=4273090d8f6e476fa85d422b7e208bda, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:22.609151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:22.628570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 835/1685] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:22 2022] PUT /identity/v3/projects/f4ccd4ccd923488cbee14d3c67611e13/users/4273090d8f6e476fa85d422b7e208bda/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:22.633260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:22.648731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450d352-e969-4309-9cdf-b162c1c2b3ac admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:22.786459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64352a0f-25da-4eb3-bed0-945e5bb97c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:22.787310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352a0f-25da-4eb3-bed0-945e5bb97c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.787703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352a0f-25da-4eb3-bed0-945e5bb97c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.788116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352a0f-25da-4eb3-bed0-945e5bb97c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:22.789016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64352a0f-25da-4eb3-bed0-945e5bb97c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:22.795000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64352a0f-25da-4eb3-bed0-945e5bb97c36 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:22.824385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 851/1686] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:22.832324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:22.840351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:22.862602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241b25a-bf9a-432d-ac8f-51b20760214e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:22.882938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:22.886179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.886504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.886790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] PATH_INFO: `/v3/projects/f4ccd4ccd923488cbee14d3c67611e13/users/4273090d8f6e476fa85d422b7e208bda/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:22.896333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ccd4ccd923488cbee14d3c67611e13, user_id=4273090d8f6e476fa85d422b7e208bda, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:22.906190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:22.949659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 836/1687] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:22 2022] PUT /identity/v3/projects/f4ccd4ccd923488cbee14d3c67611e13/users/4273090d8f6e476fa85d422b7e208bda/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:22.950763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:22.951451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:22.952063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:23.017653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] MFA Rules not processed for user `4273090d8f6e476fa85d422b7e208bda`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:23.019188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:23.048972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:23.304533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 852/1688] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:23.312117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:23.316357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:23.532597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3186a3-1c64-4178-80e7-72d097b8f505 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:23.544356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:23.549528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:23.552026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:23.552335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:23.621689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:23.623942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:23.624086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:23.626061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:23.657587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 837/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:23.696433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:23.701730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:23.858988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3d59-acbc-4152-928c-4603dec0bfd1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:23.870372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:23.872197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:23.873878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:23.877024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] PATH_INFO: `/v3/projects/d60a74104bf1414c99bbe20e7dc27c41` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:23.878929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60a74104bf1414c99bbe20e7dc27c41)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:23.881431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:23.920503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316623-04a6-4dbc-938c-662249c69a5b service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:23.939506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:23.940434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:23.940712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:23.940983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] PATH_INFO: `/v3/projects/1759432e8a694e6786c7ae161380c157` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:23.947283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1759432e8a694e6786c7ae161380c157)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:23.949496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:23.991788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60a74104bf1414c99bbe20e7dc27c41', 'request_id': 'req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.004204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60a74104bf1414c99bbe20e7dc27c41', 'request_id': 'req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.012245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60a74104bf1414c99bbe20e7dc27c41', 'request_id': 'req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.025730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1759432e8a694e6786c7ae161380c157', 'request_id': 'req-c0716655-2369-4219-8d67-174edb867054'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.033414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] The token cache is being invalidate because project d60a74104bf1414c99bbe20e7dc27c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:24.033754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.034516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.036517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 853/1690] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:23 2022] DELETE /identity/v3/projects/d60a74104bf1414c99bbe20e7dc27c41 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:24.039000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1759432e8a694e6786c7ae161380c157', 'request_id': 'req-c0716655-2369-4219-8d67-174edb867054'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.041039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:24.043255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:24.050937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1759432e8a694e6786c7ae161380c157', 'request_id': 'req-c0716655-2369-4219-8d67-174edb867054'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.073774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] The token cache is being invalidate because project 1759432e8a694e6786c7ae161380c157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:24.074059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.075522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.081848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 838/1691] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:23 2022] DELETE /identity/v3/projects/1759432e8a694e6786c7ae161380c157 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:24.085942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:24.086941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:24.123188 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:24.138577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:24.182583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0661c-ba3a-418a-8b76-6d1fefdc750e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:24.232107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0716655-2369-4219-8d67-174edb867054 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:24.246774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:24.247855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:24.248141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:24.248417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] PATH_INFO: `/v3/users/34c49f22ac764f718375b0696a9bf3e7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:24.249996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c49f22ac764f718375b0696a9bf3e7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:24.256116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:24.357899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:24.359519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:24.360066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:24.360687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] PATH_INFO: `/v3/users/becfa896d92b4a94a6b2b946cc656ee8` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:24.363197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=becfa896d92b4a94a6b2b946cc656ee8)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:24.365938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:24.394671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c49f22ac764f718375b0696a9bf3e7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.407322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c49f22ac764f718375b0696a9bf3e7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.436697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c49f22ac764f718375b0696a9bf3e7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.443858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c49f22ac764f718375b0696a9bf3e7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.472905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29d88b3a-5457-4104-86d7-b67ef5964f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c49f22ac764f718375b0696a9bf3e7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.479270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'becfa896d92b4a94a6b2b946cc656ee8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.503945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'becfa896d92b4a94a6b2b946cc656ee8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.508451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 839/1692] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:24 2022] DELETE /identity/v3/users/34c49f22ac764f718375b0696a9bf3e7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:24.510720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38cbc3-2994-4f6f-8902-772784af718f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:24.512236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38cbc3-2994-4f6f-8902-772784af718f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:24.512777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38cbc3-2994-4f6f-8902-772784af718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:24.533433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'becfa896d92b4a94a6b2b946cc656ee8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.534468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'becfa896d92b4a94a6b2b946cc656ee8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.549795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bd38cbc3-2994-4f6f-8902-772784af718f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:24.551283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bd38cbc3-2994-4f6f-8902-772784af718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:24.555083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c60e154e-2305-4be3-82b4-8f6149a6fd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'becfa896d92b4a94a6b2b946cc656ee8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:24.569011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 854/1693] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:24 2022] DELETE /identity/v3/users/becfa896d92b4a94a6b2b946cc656ee8 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:24.569011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ad557-9a37-4377-af5b-3256e47640ef None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:24.569011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ad557-9a37-4377-af5b-3256e47640ef None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:24.569011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ad557-9a37-4377-af5b-3256e47640ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:24.637418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-090ad557-9a37-4377-af5b-3256e47640ef None None] MFA Rules not processed for user `4247e1dc34ef44c5b933e105d170911d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:24.638645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-090ad557-9a37-4377-af5b-3256e47640ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:24.719082 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 840/1694] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:24.728080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:24.728417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:24.728703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:24.782373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:24.784512 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:24.795922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:24.840099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 855/1695] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:24.843974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:24.844539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:24.845069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:24.895664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:24.900102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:24.919991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:24.996560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 841/1696] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:24.998254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.004614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:25.021260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 856/1697] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:25.025941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.046648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef5f36-4759-4e89-8b37-4e2b05c61217 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.055643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.057199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.057688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.058119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.059128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:25.059664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.062782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.095892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 857/1698] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:25.097364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.099839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:25.178350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62fca-e081-40cd-9945-76bafb20f4e4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.195500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.196629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.196629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.196813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.215881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.221117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.249013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 842/1699] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:25.251694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.275241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b92f16-c63e-4351-aeb7-f4c8f348ccd7 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.286986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.287687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.288009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.288292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.289153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.294277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.350701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070efcc-1e72-4eb0-a1db-cd0958866c60 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.356018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 843/1700] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:25 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:25.362301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.543468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e908e-b278-48e8-a5f1-34279aaa6c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.546595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e908e-b278-48e8-a5f1-34279aaa6c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.559793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e908e-b278-48e8-a5f1-34279aaa6c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.560786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e908e-b278-48e8-a5f1-34279aaa6c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.567550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e3f47-5040-46fe-8ee4-66ce60f58815 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.585518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.587544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.588089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.588724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.594370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.600799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e908e-b278-48e8-a5f1-34279aaa6c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.602625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e908e-b278-48e8-a5f1-34279aaa6c15 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.603983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.637621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 858/1701] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:25.640263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.640938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.641729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.660105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 844/1702] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:25 2022] POST /identity/v3/users => generated 278 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:25.661251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.666706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] MFA Rules not processed for user `2c6ad0ad11944b81accd2f70a322d176`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:25.668722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:25.681368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf316d7-8c28-42e2-952d-ae70f57d1e95 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.694027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.694967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.695409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.695696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.696511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.698124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.715068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:25.728216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 845/1703] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:36:25.731672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.748451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 859/1704] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:25.761881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182c7f-598c-443a-bcab-fa13fc820697 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.776465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.777701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.778214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.778845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.779825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.782213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.812258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 846/1705] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:25.816162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.841020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a815b67-d859-440f-97e4-d794789668e6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.865904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46f6a-e369-4d5c-a4b3-59dc0b652f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.866840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46f6a-e369-4d5c-a4b3-59dc0b652f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.867124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46f6a-e369-4d5c-a4b3-59dc0b652f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.867400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46f6a-e369-4d5c-a4b3-59dc0b652f75 admin admin] PATH_INFO: `/v3/projects/c253533ea1bf42399a632ee8540a733d/users/fbd3581786964a719b4e3c0c19d72c66/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.901045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:25.903520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:25.921150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdbd8d-6a33-4bf5-bf7e-7fb5a019bb5a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:25.926981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46f6a-e369-4d5c-a4b3-59dc0b652f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c253533ea1bf42399a632ee8540a733d, user_id=fbd3581786964a719b4e3c0c19d72c66, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.929168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:25.930286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.930924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.931252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] PATH_INFO: `/v3/projects/538e6ee8b71846458c48a3f2a85c94cb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.935490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46f6a-e369-4d5c-a4b3-59dc0b652f75 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.940217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=538e6ee8b71846458c48a3f2a85c94cb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:25.945633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:25.967397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 860/1706] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:25 2022] PUT /identity/v3/projects/c253533ea1bf42399a632ee8540a733d/users/fbd3581786964a719b4e3c0c19d72c66/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:25.978577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:25.978786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:25.979044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:25.993944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:26.049003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] MFA Rules not processed for user `fbd3581786964a719b4e3c0c19d72c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:26.050267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:26.068527 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538e6ee8b71846458c48a3f2a85c94cb', 'request_id': 'req-88a18a0e-a726-4cf6-ba77-094371f28e6a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:26.094123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538e6ee8b71846458c48a3f2a85c94cb', 'request_id': 'req-88a18a0e-a726-4cf6-ba77-094371f28e6a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:26.113641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538e6ee8b71846458c48a3f2a85c94cb', 'request_id': 'req-88a18a0e-a726-4cf6-ba77-094371f28e6a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:26.143656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] The token cache is being invalidate because project 538e6ee8b71846458c48a3f2a85c94cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:26.144273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:26.144723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a18a0e-a726-4cf6-ba77-094371f28e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:26.149178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 847/1707] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:25 2022] DELETE /identity/v3/projects/538e6ee8b71846458c48a3f2a85c94cb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:26.154386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72bc1-975f-4e16-877f-cda0f67decbc None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.154761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72bc1-975f-4e16-877f-cda0f67decbc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.155110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72bc1-975f-4e16-877f-cda0f67decbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.177714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-65b72bc1-975f-4e16-877f-cda0f67decbc None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:26.179122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-65b72bc1-975f-4e16-877f-cda0f67decbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:26.209229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 861/1708] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:25 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:26.210447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.212388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:26.305120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 848/1709] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:26.308758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.309056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.309338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.354219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a52aad-bac2-4043-9f38-4848d5b790c3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.359481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.360227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.360510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.360743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:26.360843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.361487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.361980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:26.363469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.389096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 849/1710] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:26.393838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.405469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0d53-99da-42fa-8067-e8ed4518822c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.412160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.413025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.413313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.413586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.414877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:26.416779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.418521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.439310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 850/1711] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:36:26.440362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.449598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 862/1712] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:26 2022] POST /identity/v3/projects => generated 355 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:26.453043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851bf33-07f5-4095-90ce-f7f705564e32 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.465604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.551624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:26.566638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.567677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.567999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.568276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.569327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.572576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.600917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528e18-c111-452e-b3e7-61cf58aceb8a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.605825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.606530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.606813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.607091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.607812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.609802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.616906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 851/1713] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:26 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:26.622049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.632430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:26.657856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 863/1714] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:26 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:26.658987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.686195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8106f7b-c06a-47ff-9ff1-288b5d78d5b2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.776954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590222-dfe5-49df-944a-77569209b603 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.784317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.785487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.785845 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.786141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.786861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.789775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.823339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.824083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.824371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.824651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.826206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 852/1715] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:26 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:26.827054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.832800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.834583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.847880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f40e-2442-462c-90ff-6bddc9cd07ae admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.853710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.854577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.854860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.855187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.856329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.857971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.864077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 864/1716] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:26.865163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.871808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 853/1717] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:26.876589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.889097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da782c-7210-4b1c-a973-4fee0c61c00c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.893604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9bfb2-2817-4996-8594-d622b00be4c3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:26.900485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.901627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.902864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.903325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:26.903547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] PATH_INFO: `/v3/projects/66ab64774a054c12b464d18d28473c1d/users/35aa6c860b314cc894493b8141b1896e/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.904404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:26.904537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:26.904895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:26.905677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.911780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.927516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab64774a054c12b464d18d28473c1d, user_id=35aa6c860b314cc894493b8141b1896e, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:26.930859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:26.946167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 854/1718] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:36:26.947885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.966081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 865/1719] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:26 2022] PUT /identity/v3/projects/66ab64774a054c12b464d18d28473c1d/users/35aa6c860b314cc894493b8141b1896e/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:26.967356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:26.974500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5558391-df2b-40ab-aca2-42911edc7409 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:27.116680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a25cc-d6da-4745-ba10-cd7423794bb4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:27.127479 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dcacb-1dd0-4e01-adb4-0b170fe7e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:27.128789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:27.129384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dcacb-1dd0-4e01-adb4-0b170fe7e101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.129493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.130637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dcacb-1dd0-4e01-adb4-0b170fe7e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.130914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.131020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dcacb-1dd0-4e01-adb4-0b170fe7e101 admin admin] PATH_INFO: `/v3/projects/870c5ccd7a3a446aa1cac299df21dbcd/users/d9476810920a4d5d8ed7b54332546496/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.131202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.133521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:27.138187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:27.166470 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 866/1720] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:27.172771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:27.185233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dcacb-1dd0-4e01-adb4-0b170fe7e101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870c5ccd7a3a446aa1cac299df21dbcd, user_id=d9476810920a4d5d8ed7b54332546496, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:27.188315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dcacb-1dd0-4e01-adb4-0b170fe7e101 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:27.191533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a4c4c-96c2-4a00-95fe-587033c756b7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:27.206439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff58f4b-6b72-4ac4-a86d-cd0448b7b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:27.207618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff58f4b-6b72-4ac4-a86d-cd0448b7b1af admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.208109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff58f4b-6b72-4ac4-a86d-cd0448b7b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.208693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff58f4b-6b72-4ac4-a86d-cd0448b7b1af admin admin] PATH_INFO: `/v3/projects/66ab64774a054c12b464d18d28473c1d/users/35aa6c860b314cc894493b8141b1896e/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.211190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff58f4b-6b72-4ac4-a86d-cd0448b7b1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab64774a054c12b464d18d28473c1d, user_id=35aa6c860b314cc894493b8141b1896e, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:27.214354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff58f4b-6b72-4ac4-a86d-cd0448b7b1af admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:27.225804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 855/1721] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:26 2022] PUT /identity/v3/projects/870c5ccd7a3a446aa1cac299df21dbcd/users/d9476810920a4d5d8ed7b54332546496/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:27.232424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 867/1722] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:27 2022] PUT /identity/v3/projects/66ab64774a054c12b464d18d28473c1d/users/35aa6c860b314cc894493b8141b1896e/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:27.242270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.242566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.242846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.244492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.244780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.245052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.308466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] MFA Rules not processed for user `35aa6c860b314cc894493b8141b1896e`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:27.309731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:27.327039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:27.329064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] MFA Rules not processed for user `d9476810920a4d5d8ed7b54332546496`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:27.330554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:27.433635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:27.469138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 868/1723] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:27 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:27.479147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 856/1724] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:27.481330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:27.483206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:27.488405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:27.562306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e78a20-726f-4e4c-8ad8-f1ed48227df1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:27.567340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:27.568070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.568357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.568637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.569347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:27.571437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:27.604381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 869/1725] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:27.608243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:27.612414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a1ea7-cccc-41a0-b03c-f61b98cf579f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:27.719557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6c0a-76ef-43b2-a4d2-3d33100e00bc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:27.724425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268eead-4b25-41cf-8513-d30840625cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:27.725789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268eead-4b25-41cf-8513-d30840625cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.727468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268eead-4b25-41cf-8513-d30840625cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.731247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268eead-4b25-41cf-8513-d30840625cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.736827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044dc96-d010-4043-8580-952b75cbd019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:27.738782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044dc96-d010-4043-8580-952b75cbd019 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.741578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044dc96-d010-4043-8580-952b75cbd019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.743869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044dc96-d010-4043-8580-952b75cbd019 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.745989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044dc96-d010-4043-8580-952b75cbd019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:27.751747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044dc96-d010-4043-8580-952b75cbd019 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:27.825793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 870/1726] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:27 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:27.829978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:27.830417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:27.830846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:27.959553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] MFA Rules not processed for user `522718a05dfe48f291a687006be5d014`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:27.962578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:27.988661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:27.991993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268eead-4b25-41cf-8513-d30840625cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:27.993866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268eead-4b25-41cf-8513-d30840625cc6 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:28.039296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 857/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:27 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:28.047418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.049807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.054860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.159296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] MFA Rules not processed for user `3e9653f2408549da853449559ec820b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:28.162628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:28.201663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 871/1728] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:28.203184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.228699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe5663-8aec-4209-acdf-30c915d84c84 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:28.238003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4704c7-cac3-46ec-a779-15588dd943b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:28.253282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4704c7-cac3-46ec-a779-15588dd943b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.253669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4704c7-cac3-46ec-a779-15588dd943b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.254048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4704c7-cac3-46ec-a779-15588dd943b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.254907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4704c7-cac3-46ec-a779-15588dd943b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:28.257027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4704c7-cac3-46ec-a779-15588dd943b8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:28.270045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 872/1729] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:28.271550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba111-e395-4a9f-a02a-6c28a943d9c8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.271937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba111-e395-4a9f-a02a-6c28a943d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.272283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba111-e395-4a9f-a02a-6c28a943d9c8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.274210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 873/1730] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 20 09:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:28.275536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.275913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.276262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.286216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:28.301417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] MFA Rules not processed for user `522718a05dfe48f291a687006be5d014`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:28.302952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:28.312912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 874/1731] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:28.313917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.332429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac5a3-f002-4333-af1a-1291f6cf319e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:28.336927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:28.337881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.338259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.338998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.357382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 858/1732] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:28.357382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.381047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4010f43-5d09-4d5b-a9c4-7bedad45f55b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:28.396050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e3cb-838e-4e54-821a-e7eecbd57484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:28.396810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e3cb-838e-4e54-821a-e7eecbd57484 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.397121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e3cb-838e-4e54-821a-e7eecbd57484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.397461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e3cb-838e-4e54-821a-e7eecbd57484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.398253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00e3cb-838e-4e54-821a-e7eecbd57484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:28.399925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00e3cb-838e-4e54-821a-e7eecbd57484 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:28.424481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 859/1733] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:28.435603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.437304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.437613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.454487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:28.456833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:28.493534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 875/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:28 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:28.507192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.509548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:28.535542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:28.537310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:28.698034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 860/1735] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:36:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:28.699232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.703576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:28.741449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c0a7f-c004-441d-841a-2683db0079bf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:28.755151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:28.756216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.756622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.757495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] PATH_INFO: `/v3/projects/e6e12f72e65e43368a31b2faff28f28b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.759629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e12f72e65e43368a31b2faff28f28b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:28.764476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:28.797302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f059-59fe-4d6a-ae23-0f4c54fe6c2e service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:28.823638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:28.825055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:28.827090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:28.828476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:28.861202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:28.864584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:28.894348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 876/1736] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:28.894821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e12f72e65e43368a31b2faff28f28b', 'request_id': 'req-5ebacddb-ab5f-45d4-bb99-2284779d8442'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:28.896749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.912390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e12f72e65e43368a31b2faff28f28b', 'request_id': 'req-5ebacddb-ab5f-45d4-bb99-2284779d8442'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:28.926239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e12f72e65e43368a31b2faff28f28b', 'request_id': 'req-5ebacddb-ab5f-45d4-bb99-2284779d8442'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:28.926468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59612cf1-0f45-4bf2-ae8f-dd9b778a0b77 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:28.955819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:28.956121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] The token cache is being invalidate because project e6e12f72e65e43368a31b2faff28f28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:28.956835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:28.959936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:28.964429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 861/1737] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:28 2022] DELETE /identity/v3/projects/e6e12f72e65e43368a31b2faff28f28b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:28.968662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:28.974606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:29.076848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:29.077786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:29.078039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:29.078319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] PATH_INFO: `/v3/projects/f3bcf11cac724055816b8b055ed628e2/users/6d1646d7fcfe484bb84fa9d577100ae9/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:29.115343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bcf11cac724055816b8b055ed628e2, user_id=6d1646d7fcfe484bb84fa9d577100ae9, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:29.118600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:29.135960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:29.164073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 877/1738] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:28 2022] PUT /identity/v3/projects/f3bcf11cac724055816b8b055ed628e2/users/6d1646d7fcfe484bb84fa9d577100ae9/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:29.164073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:29.164073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:29.170280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacddb-ab5f-45d4-bb99-2284779d8442 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:29.312434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9d2d-bcc5-4f15-a303-a1c0922fd642 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:29.331371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:29.332345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:29.332653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:29.332929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] PATH_INFO: `/v3/users/4273090d8f6e476fa85d422b7e208bda` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:29.334913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4273090d8f6e476fa85d422b7e208bda)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:29.336930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:29.357092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:29.357689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:29.358122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:29.358937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:29.365849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:29.391931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:29.395381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d9f23-58db-487a-8225-5bfd12c00d9a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:29.425420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 862/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:29.428924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:29.429243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:29.429527 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:29.463141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4273090d8f6e476fa85d422b7e208bda'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:29.479707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4273090d8f6e476fa85d422b7e208bda'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:29.511964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] MFA Rules not processed for user `6d1646d7fcfe484bb84fa9d577100ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:29.513172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4273090d8f6e476fa85d422b7e208bda'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:29.515522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4273090d8f6e476fa85d422b7e208bda'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:29.516531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:29.537377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4273090d8f6e476fa85d422b7e208bda'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:29.562232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 878/1740] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:29 2022] DELETE /identity/v3/users/4273090d8f6e476fa85d422b7e208bda => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:29.727265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 863/1741] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:29.731506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:29.733321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:29.776847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:29.990931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e641bbd-986a-4f90-bdbe-da948aa290b1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.001182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf9fe-86e1-470a-8e16-997228f8f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.001883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf9fe-86e1-470a-8e16-997228f8f6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.002172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf9fe-86e1-470a-8e16-997228f8f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.002454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf9fe-86e1-470a-8e16-997228f8f6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.007760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf9fe-86e1-470a-8e16-997228f8f6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.009884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf9fe-86e1-470a-8e16-997228f8f6b4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.105076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:30.114950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 879/1742] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:29 2022] POST /identity/v3/projects => generated 385 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:30.119707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17681f-12e0-49c4-b4a4-086320f26c57 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.241893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88575c7-7322-441f-8ab8-5e6c4cded3f9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.241893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88575c7-7322-441f-8ab8-5e6c4cded3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.242298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88575c7-7322-441f-8ab8-5e6c4cded3f9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.243859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 880/1743] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 20 09:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 09:36:30.249525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.250036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.250500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.313616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:30.318862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.319603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:30.320681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.320983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.321266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.323351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.326472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.396359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 864/1744] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:30 2022] POST /identity/v3/users => generated 299 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:30.399289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:30.422338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1650-9e78-428a-b3da-23997b19bcdd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.438082 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.439484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.439896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.440269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.442473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.448238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.482648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 865/1745] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:30.484115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:30.490772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 881/1746] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:36:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 20 09:36:30.500162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1f25-42e9-40b1-b087-c2ec2ac22de2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.505700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.506767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.507161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.507545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] PATH_INFO: `/v3/projects/ed036fda46de4d9f999a27a5895e2e6b/users/31bec39d2c254a90953285e48fb7cce1/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.528780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:30.536477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed036fda46de4d9f999a27a5895e2e6b, user_id=31bec39d2c254a90953285e48fb7cce1, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.539675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.553992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:30.557693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:30.576478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bbb5e-652e-44f0-bd67-fb0b4160b7d0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.578353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 866/1747] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:30 2022] PUT /identity/v3/projects/ed036fda46de4d9f999a27a5895e2e6b/users/31bec39d2c254a90953285e48fb7cce1/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:30.582108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:30.695008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.695753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.696044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.696323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.723334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.726618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.758511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663fc5c-522e-4974-a1e5-c3166f1028ce admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.759191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 882/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:36:30.771657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d479c-9d5c-4abd-a87e-a44af52bb595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.772433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d479c-9d5c-4abd-a87e-a44af52bb595 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.772723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d479c-9d5c-4abd-a87e-a44af52bb595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.773034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d479c-9d5c-4abd-a87e-a44af52bb595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.773881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d479c-9d5c-4abd-a87e-a44af52bb595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.775607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d479c-9d5c-4abd-a87e-a44af52bb595 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.795536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 867/1749] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:30.800186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:30.819975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af0c61-0b32-4a48-9592-1d6d7a13cdcd service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:30.836358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf2388-c809-4138-856a-cbe2aa3b7c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:30.837288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2388-c809-4138-856a-cbe2aa3b7c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.837575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2388-c809-4138-856a-cbe2aa3b7c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.837851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf2388-c809-4138-856a-cbe2aa3b7c9c admin admin] PATH_INFO: `/v3/projects/ed036fda46de4d9f999a27a5895e2e6b/users/31bec39d2c254a90953285e48fb7cce1/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.844044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf2388-c809-4138-856a-cbe2aa3b7c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed036fda46de4d9f999a27a5895e2e6b, user_id=31bec39d2c254a90953285e48fb7cce1, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:30.846767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf2388-c809-4138-856a-cbe2aa3b7c9c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:30.875548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 883/1750] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:30 2022] PUT /identity/v3/projects/ed036fda46de4d9f999a27a5895e2e6b/users/31bec39d2c254a90953285e48fb7cce1/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:30.887265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:30.887670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:30.888013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:30.937531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] MFA Rules not processed for user `31bec39d2c254a90953285e48fb7cce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:30.938857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:31.079176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:31.079693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:31.079693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:31.080351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 868/1751] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:31.095098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:31.097229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:31.130471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] MFA Rules not processed for user `4247e1dc34ef44c5b933e105d170911d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:31.131821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:31.205818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98cd54-ced0-43d0-bc34-9564f5fa0312 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:31.210525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d501710-2308-48ba-9562-ca83761f941d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:31.211347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501710-2308-48ba-9562-ca83761f941d service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:31.212588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:31.213749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501710-2308-48ba-9562-ca83761f941d service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:31.213749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501710-2308-48ba-9562-ca83761f941d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:31.230774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d501710-2308-48ba-9562-ca83761f941d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:31.233052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d501710-2308-48ba-9562-ca83761f941d service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:31.253749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 869/1752] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:31.262183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:31.264174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 884/1753] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:31.265092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:31.265688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:31.309266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:31.319667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] MFA Rules not processed for user `cddf62fa4ca944cabb9d3b91f38fde62`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:31.322150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:31.454521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:31.456332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:31.707343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98c143-18f4-4324-8d82-e5d1a7658ba7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:31.711961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 870/1754] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:31.713280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:31.720572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:31.725617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:31.728702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:31.730809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:31.731189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] PATH_INFO: `/v3/projects/f4ccd4ccd923488cbee14d3c67611e13` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:31.739452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ccd4ccd923488cbee14d3c67611e13)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:31.751590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:31.922328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ccd4ccd923488cbee14d3c67611e13', 'request_id': 'req-feb9a33e-cce3-4239-8b22-3f544bddefcd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:31.958341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ccd4ccd923488cbee14d3c67611e13', 'request_id': 'req-feb9a33e-cce3-4239-8b22-3f544bddefcd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:31.964802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a43b-fdb3-4c6e-9e3b-5455f34ba19b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:31.985110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ccd4ccd923488cbee14d3c67611e13', 'request_id': 'req-feb9a33e-cce3-4239-8b22-3f544bddefcd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:32.010725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] The token cache is being invalidate because project f4ccd4ccd923488cbee14d3c67611e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:32.012052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:32.013805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feb9a33e-cce3-4239-8b22-3f544bddefcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:32.019302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 885/1755] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:31 2022] DELETE /identity/v3/projects/f4ccd4ccd923488cbee14d3c67611e13 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:36:32.021481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47459-23e9-47a3-9c97-99ea06f2e832 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.021930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47459-23e9-47a3-9c97-99ea06f2e832 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.022454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47459-23e9-47a3-9c97-99ea06f2e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.059274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-17c47459-23e9-47a3-9c97-99ea06f2e832 None None] MFA Rules not processed for user `cddf62fa4ca944cabb9d3b91f38fde62`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:32.060916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-17c47459-23e9-47a3-9c97-99ea06f2e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.138360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:32.139391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.140280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.140562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.148240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.218297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 886/1756] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:32.221417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50940a5-2780-4dfb-adeb-3ad0f41eb63d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.222799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50940a5-2780-4dfb-adeb-3ad0f41eb63d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.223071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50940a5-2780-4dfb-adeb-3ad0f41eb63d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.227571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 887/1757] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 20 09:36:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:32.228891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.229179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.229462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.246351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:32.276888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:32.278236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.293735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:32.295474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bda54-4186-40a1-9593-7f91c85deedd service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:32.312239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 871/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:32.313673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9a11-991a-4b9f-9e57-1a04fa373e5e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.313967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9a11-991a-4b9f-9e57-1a04fa373e5e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.314263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9a11-991a-4b9f-9e57-1a04fa373e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.334242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3f6f9a11-991a-4b9f-9e57-1a04fa373e5e None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:32.335092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:32.335986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3f6f9a11-991a-4b9f-9e57-1a04fa373e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.412536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 888/1759] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:32.412536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:32.412536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.493124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 872/1760] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 20 09:36:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:32.494516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.494811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.495094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.537285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26035e9-b1a7-4713-821b-f16993d69319 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:32.550357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:32.553804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.554132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.554825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.560212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.570949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:32.572687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:32.598928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 873/1761] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:32.602689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:32.619012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:32.620691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:32.631686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177239f0-826d-421b-8096-6ea3ae1e26c9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:32.647358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:32.648613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.649001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.649894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.654049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 889/1762] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:32.654914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:32.675897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:32.677713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:32.711898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3038e-e6b3-4b82-ac51-d3e8cf9bf318 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:32.743398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:32.744130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.744411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.744686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.745426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:32.745734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:32.747357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:32.760944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 874/1763] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:32.863971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 890/1764] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:32.869006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:32.895755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b648351-c0ee-4326-8073-183123b394e9 service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:32.925092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:32.925908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:32.927209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:32.927498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:32.943597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:32.949602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:33.041018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:33.045427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 875/1765] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:32 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:33.058177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e3628-f1e0-4e08-897e-c588c02babda admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:33.173726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:33.177146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:33.293307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13660b5-f7a6-4139-a99c-093d61c7fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:33.294139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13660b5-f7a6-4139-a99c-093d61c7fe4d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:33.294520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13660b5-f7a6-4139-a99c-093d61c7fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:33.294889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13660b5-f7a6-4139-a99c-093d61c7fe4d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:33.295808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13660b5-f7a6-4139-a99c-093d61c7fe4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:33.301344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13660b5-f7a6-4139-a99c-093d61c7fe4d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:33.361554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 891/1766] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:33 2022] POST /identity/v3/users => generated 282 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:33.361554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:33.361554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:33.361554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:33.366591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519dee8-3cbf-46a6-baf7-8f479c67fca9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:33.379157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:33.379794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:33.380089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:33.380365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:33.388407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:33.505251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] MFA Rules not processed for user `522718a05dfe48f291a687006be5d014`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:33.513484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:33.536523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:33.589461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:33.604580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:33.629325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 876/1767] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:36:33.634292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:33.648465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:33.666146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:33.786802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 892/1768] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:33.788257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:33.815136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b1b8b-7673-44f2-ac90-42e447d293fb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:33.840093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:33.840803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:33.841085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:33.841358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:33.842106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:33.845640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:33.883700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 893/1769] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:33.890694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:33.920531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366e2d9-778f-4b70-bda4-d999919f9719 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:33.943129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:33.943862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:33.944148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:33.944423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:33.945169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:33.954524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:34.009354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 894/1770] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:34.012154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:34.022632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e157-d5e8-415d-9c63-4aedb7b0b009 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:34.045598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3367da-bb5e-433c-ba35-91962f62b952 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:34.063013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:34.063613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce0b4-86e7-4599-bf29-eeefafe37cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:34.064561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce0b4-86e7-4599-bf29-eeefafe37cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:34.064846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce0b4-86e7-4599-bf29-eeefafe37cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:34.065140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce0b4-86e7-4599-bf29-eeefafe37cfd admin admin] PATH_INFO: `/v3/projects/c401118b24494b039e5b921eebfb2a84/users/4f5d7d81607e43a0902e067533b7d805/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:34.066465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:34.066767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:34.067092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:34.079393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:34.132952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dce0b4-86e7-4599-bf29-eeefafe37cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c401118b24494b039e5b921eebfb2a84, user_id=4f5d7d81607e43a0902e067533b7d805, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:34.154579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dce0b4-86e7-4599-bf29-eeefafe37cfd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:34.194987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 895/1771] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:34 2022] PUT /identity/v3/projects/c401118b24494b039e5b921eebfb2a84/users/4f5d7d81607e43a0902e067533b7d805/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:34.207694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:34.208212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:34.208644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:34.348688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] MFA Rules not processed for user `4f5d7d81607e43a0902e067533b7d805`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:34.350181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:34.508961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:34.511877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:34.599362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 877/1772] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 964 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:34.867061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 896/1773] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 661 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:34.872721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:34.900028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831a7d-bc85-4c1d-9096-29f1c9ef01eb service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:35.138952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:35.142434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:35.144583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:35.145282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:35.150632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:35.171137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:35.228437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 878/1774] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:34 2022] POST /identity/v3/projects => generated 365 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:35.228537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:35.257442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd918d-c0a6-4398-9ffc-55e789345726 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:35.457034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:35.457898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:35.458490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:35.458993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:35.459938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:35.469161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:35.536704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 897/1775] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:35 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:35.540780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:35.562509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc0487-9f57-44fe-b749-ead55cffd68d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:35.589476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:35.593920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:35.594278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:35.596498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:35.604385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:35.608203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:35.618918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:35.674106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 879/1776] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:35.675241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:35.693371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688b3d-c2c4-4e88-978c-64bc33177d75 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:35.719513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:35.720960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:35.722368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:35.723952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] PATH_INFO: `/v3/projects/d5557e80b1754979ac686ddf34bc7e92/users/39d58656aa854786b7881a80c0749219/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:35.733007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:35.780728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5557e80b1754979ac686ddf34bc7e92, user_id=39d58656aa854786b7881a80c0749219, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:35.787751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:35.868077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 898/1777] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:35 2022] PUT /identity/v3/projects/d5557e80b1754979ac686ddf34bc7e92/users/39d58656aa854786b7881a80c0749219/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:36:35.872213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:35.891591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffd4c-86f1-4713-97b9-f851be366d21 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:36.161642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ebb3a-1d17-4193-a583-332d3054b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:36.163086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ebb3a-1d17-4193-a583-332d3054b393 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:36.163528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ebb3a-1d17-4193-a583-332d3054b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:36.163990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ebb3a-1d17-4193-a583-332d3054b393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:36.164930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ebb3a-1d17-4193-a583-332d3054b393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:36.167181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ebb3a-1d17-4193-a583-332d3054b393 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:36.186405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 880/1778] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:36.192334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:36.222615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2a8d-31ba-46c7-a01e-75166248b268 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:36.237011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:36.239668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:36.240686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:36.241481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] PATH_INFO: `/v3/projects/d5557e80b1754979ac686ddf34bc7e92/users/39d58656aa854786b7881a80c0749219/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:36.248632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5557e80b1754979ac686ddf34bc7e92, user_id=39d58656aa854786b7881a80c0749219, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:36.256789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:36.292548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 899/1779] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:36 2022] PUT /identity/v3/projects/d5557e80b1754979ac686ddf34bc7e92/users/39d58656aa854786b7881a80c0749219/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:36.309775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581f19-fdd5-42b2-a803-90ce585f91f2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:36.310321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581f19-fdd5-42b2-a803-90ce585f91f2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:36.310727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581f19-fdd5-42b2-a803-90ce585f91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:36.384176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-48581f19-fdd5-42b2-a803-90ce585f91f2 None None] MFA Rules not processed for user `39d58656aa854786b7881a80c0749219`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:36.387243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-48581f19-fdd5-42b2-a803-90ce585f91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:36.498640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 881/1780] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:36.512143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:36.516917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:36.719745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb05fdb-0da3-4de5-8504-65db6fa14c34 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:36.735565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:36.736477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:36.736937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:36.737370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:36.768967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:36.772206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:36.803416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 900/1781] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:37.806415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293aa0e-0427-44bb-b006-3e7c1d89b3a6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:37.806919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293aa0e-0427-44bb-b006-3e7c1d89b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:37.808241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293aa0e-0427-44bb-b006-3e7c1d89b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:37.893316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9293aa0e-0427-44bb-b006-3e7c1d89b3a6 None None] MFA Rules not processed for user `3e9653f2408549da853449559ec820b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:37.897883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9293aa0e-0427-44bb-b006-3e7c1d89b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:38.048585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:38.163138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 882/1782] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:38.338976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b720bf-c7c2-46b5-98f4-783b1433b6c1 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:38.372031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:38.372988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:38.373436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:38.373817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] PATH_INFO: `/v3/users/4f5d7d81607e43a0902e067533b7d805` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:38.376488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5d7d81607e43a0902e067533b7d805)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:38.396247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:38.612441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5d7d81607e43a0902e067533b7d805'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:38.627779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5d7d81607e43a0902e067533b7d805'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:38.661518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5d7d81607e43a0902e067533b7d805'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:38.663515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5d7d81607e43a0902e067533b7d805'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:38.667947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:38.704579 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5d7d81607e43a0902e067533b7d805'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:38.735691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 901/1783] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:38 2022] DELETE /identity/v3/users/4f5d7d81607e43a0902e067533b7d805 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:38.740239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d8564-6dd0-49b4-965f-69ff94a2deb9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:38.740585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d8564-6dd0-49b4-965f-69ff94a2deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:38.740915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d8564-6dd0-49b4-965f-69ff94a2deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:38.795448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b86d8564-6dd0-49b4-965f-69ff94a2deb9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:38.796816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b86d8564-6dd0-49b4-965f-69ff94a2deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:38.876347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:39.000598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 883/1784] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:39.012360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:39.016537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:39.068191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:39.068791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:39.069261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:39.250848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee1f7-7509-46cc-bf15-b0fddad8cc04 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:39.257138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:39.258385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:39.262968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:39.270162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:39.271225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:39.271519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:39.325133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:39.338034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:39.392057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 902/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:39.514414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 884/1786] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:39.761505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:39.769491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:40.107050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc5e0-9d5e-4456-ab13-239313b612a1 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:40.125095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:40.125942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:40.126223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:40.127582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:40.202393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:40.216392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:40.262269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 903/1787] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:36:40.364161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:40.366240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:40.503495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544c690-fce6-4cfb-b193-47404b69d0d0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:40.520504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:40.521199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:40.521487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:40.521761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:40.526754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:40.708227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:40.726986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:40.728780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:40.749771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 885/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:42.164359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:42.165843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:42.209367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f291-b362-4e53-9764-28618ff3cfa0 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:42.224510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:42.226272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:42.226738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:42.227175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] PATH_INFO: `/v3/projects/c401118b24494b039e5b921eebfb2a84` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:42.232195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c401118b24494b039e5b921eebfb2a84)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:42.235047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:42.404599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c401118b24494b039e5b921eebfb2a84', 'request_id': 'req-e8be2d76-8658-4bbb-8043-8bc2e6081baf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:42.420053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c401118b24494b039e5b921eebfb2a84', 'request_id': 'req-e8be2d76-8658-4bbb-8043-8bc2e6081baf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:42.434715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:42.448728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c401118b24494b039e5b921eebfb2a84', 'request_id': 'req-e8be2d76-8658-4bbb-8043-8bc2e6081baf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:42.531321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] The token cache is being invalidate because project c401118b24494b039e5b921eebfb2a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:42.531609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:42.537939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e8be2d76-8658-4bbb-8043-8bc2e6081baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:42.547876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 904/1789] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:42 2022] DELETE /identity/v3/projects/c401118b24494b039e5b921eebfb2a84 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:42.551634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:42.570173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aa6da-5b0d-4933-85f7-8760ff7ecfcf service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:42.864408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:42.868522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:42.868816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:42.869110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] PATH_INFO: `/v3/users/39d58656aa854786b7881a80c0749219` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:42.877834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d58656aa854786b7881a80c0749219)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:42.884352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:43.073761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d58656aa854786b7881a80c0749219'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:43.096681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d58656aa854786b7881a80c0749219'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:43.158652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d58656aa854786b7881a80c0749219'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:43.159861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d58656aa854786b7881a80c0749219'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:43.182671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d58656aa854786b7881a80c0749219'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:43.204791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 886/1790] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:42 2022] DELETE /identity/v3/users/39d58656aa854786b7881a80c0749219 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:43.654900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:43.655837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:43.656827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:43.707190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:43.714725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:43.916727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 905/1791] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 20 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:44.053823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:44.057123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:44.118740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:44.120333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:44.129564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2be86-5570-46ba-ad6f-93f2b6ee1661 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:44.149749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:44.153249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1af635-2833-4566-9cb6-8b77868c23a3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:44.154207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:44.155697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:44.156357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:44.178116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac431a-2811-4298-b3fc-c198e437a200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:44.181234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac431a-2811-4298-b3fc-c198e437a200 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:44.181563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac431a-2811-4298-b3fc-c198e437a200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:44.187243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac431a-2811-4298-b3fc-c198e437a200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:44.197660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:44.207879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:44.219827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac431a-2811-4298-b3fc-c198e437a200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:44.227568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac431a-2811-4298-b3fc-c198e437a200 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:44.237811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 887/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:44.257031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 906/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:36:45.097630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:45.099999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:45.316214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:45.333529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4a716-d439-4344-8ada-d1fc2762f0c6 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:45.351692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:45.352913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:45.353351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:45.353777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] PATH_INFO: `/v3/users/d9476810920a4d5d8ed7b54332546496` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:45.355475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9476810920a4d5d8ed7b54332546496)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:45.357954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:45.491073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9476810920a4d5d8ed7b54332546496'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:45.504046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9476810920a4d5d8ed7b54332546496'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:45.548161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9476810920a4d5d8ed7b54332546496'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:45.549199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9476810920a4d5d8ed7b54332546496'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:45.569946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9476810920a4d5d8ed7b54332546496'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:45.590301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 888/1794] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:45 2022] DELETE /identity/v3/users/d9476810920a4d5d8ed7b54332546496 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:45.592004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:45.593078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:45.593442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:45.633082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:45.642157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:45.813727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 907/1795] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:45.932231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:45.933815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:46.072474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203f1f-cf3a-42fa-af2c-c643e6f8855c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:46.085411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972402d-fa7a-4f26-be81-244b0c9f2488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:46.085953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972402d-fa7a-4f26-be81-244b0c9f2488 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:46.086255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972402d-fa7a-4f26-be81-244b0c9f2488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:46.086537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972402d-fa7a-4f26-be81-244b0c9f2488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:46.108567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972402d-fa7a-4f26-be81-244b0c9f2488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:46.110107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972402d-fa7a-4f26-be81-244b0c9f2488 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:46.131787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 889/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:48.056539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:48.061965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:48.088011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427a0c-7fd1-4903-85d4-6dd795285a14 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:48.099546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:48.100668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:48.101115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:48.101594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] PATH_INFO: `/v3/projects/d5557e80b1754979ac686ddf34bc7e92` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:48.116505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5557e80b1754979ac686ddf34bc7e92)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:48.126026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:48.292239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5557e80b1754979ac686ddf34bc7e92', 'request_id': 'req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:48.311891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5557e80b1754979ac686ddf34bc7e92', 'request_id': 'req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:48.328275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5557e80b1754979ac686ddf34bc7e92', 'request_id': 'req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:48.360136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] The token cache is being invalidate because project d5557e80b1754979ac686ddf34bc7e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:48.360136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:48.362341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb3e72bc-b8f6-4fc6-9b53-0f916078215d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:48.368335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 908/1797] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:48 2022] DELETE /identity/v3/projects/d5557e80b1754979ac686ddf34bc7e92 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:48.371818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:48.373068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:48.376261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:48.426156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:48.432327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:48.572835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 890/1798] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:48.581764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:48.582847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:48.582847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:48.616354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:48.658965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:48.660512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:48.703360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:48.705980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 909/1799] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:48.719627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067791f0-cbfe-43cd-8763-f73d8ba5d3d8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:48.728692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:48.729951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:48.731197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:48.731705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:48.733011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:48.733599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:48.736332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:48.758555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 891/1800] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:48.760423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:48.778510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca2b6-2d8a-48fe-9dd0-d6da3da5d128 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:48.817756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:48.819298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:48.819828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:48.820452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:48.821840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:48.824223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:48.904962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 910/1801] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:48.906050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:48.928910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e257915-8f83-4814-968e-924cebc54703 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:48.939467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:49.074443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:49.074958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:49.075243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:49.075521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:49.076257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:49.078385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:49.132388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 892/1802] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:48 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:49.137036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:49.158329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2bf8f-4845-4e63-bbcb-90a57e5707b2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:49.180793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:49.181595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:49.182110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:49.182596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:49.183546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:49.185508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:49.220401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 911/1803] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:49.221722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:49.247908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b4ba9-33d0-4a14-91d8-632e93a045cc admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:49.263581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ec5f6-a9fd-440c-ae3c-a74845846dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:49.264574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec5f6-a9fd-440c-ae3c-a74845846dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:49.265243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec5f6-a9fd-440c-ae3c-a74845846dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:49.265243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec5f6-a9fd-440c-ae3c-a74845846dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:49.265850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ec5f6-a9fd-440c-ae3c-a74845846dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:49.280334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ec5f6-a9fd-440c-ae3c-a74845846dc7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:49.311629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 893/1804] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:49.313487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:49.336080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb44c-d2b8-457f-b75a-b66fba450718 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:49.353501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:49.354820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:49.355323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:49.355709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] PATH_INFO: `/v3/projects/502e573761004bdab0cde195ad537c45/users/93c1da48e6d240fe852672a8c31443ab/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:49.411913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502e573761004bdab0cde195ad537c45, user_id=93c1da48e6d240fe852672a8c31443ab, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:49.415953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:49.504956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:49.505667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 912/1805] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:49 2022] PUT /identity/v3/projects/502e573761004bdab0cde195ad537c45/users/93c1da48e6d240fe852672a8c31443ab/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:49.506258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:49.508506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:49.570779 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] MFA Rules not processed for user `93c1da48e6d240fe852672a8c31443ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:49.576008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:49.746595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 894/1806] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:49.752922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:49.877360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654af90f-8749-4a03-8d45-1bdbffc408c4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:49.893031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:49.893738 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:49.895031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:49.895321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:49.896095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:49.899925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:49.993112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 913/1807] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:49 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:49.998312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.019759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f802a8-9e97-4130-b61d-a65f9a01f38c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:50.163641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:50.167876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:50.168574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:50.169088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:50.170869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:50.173526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:50.218094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 895/1808] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:49 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:50.225867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.292890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020d76-08d5-4b5a-8d31-8d678ec7caaa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:50.330249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:50.331600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:50.332578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:50.333344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:50.334311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:50.336641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:50.363604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 914/1809] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:50.367828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.390348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:50.396506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8f5f5-4ff7-4685-88fc-01beb3c8434b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:50.411269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:50.412355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:50.412755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:50.413159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] PATH_INFO: `/v3/projects/89f18220a9814c12a83c79500d53450b/users/6fd62ebb09be43088e482b97f139b600/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:50.449101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f18220a9814c12a83c79500d53450b, user_id=6fd62ebb09be43088e482b97f139b600, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:50.453027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:50.482151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 896/1810] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:50 2022] PUT /identity/v3/projects/89f18220a9814c12a83c79500d53450b/users/6fd62ebb09be43088e482b97f139b600/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:50.486726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.497718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.508191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b98be-b6a8-42a7-a273-5d322abd2f37 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:50.508871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:50.695392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e155-6e35-46d2-8598-cd402c6d8bcd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:50.704916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:50.706266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:50.706859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:50.707380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] PATH_INFO: `/v3/projects/870c5ccd7a3a446aa1cac299df21dbcd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:50.709139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=870c5ccd7a3a446aa1cac299df21dbcd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:50.713928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:50.754115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceccbfb-a2eb-43cd-a486-9f7aa55086a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:50.755045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceccbfb-a2eb-43cd-a486-9f7aa55086a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:50.755347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceccbfb-a2eb-43cd-a486-9f7aa55086a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:50.755621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceccbfb-a2eb-43cd-a486-9f7aa55086a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:50.756481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceccbfb-a2eb-43cd-a486-9f7aa55086a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:50.770015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceccbfb-a2eb-43cd-a486-9f7aa55086a5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:50.822371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 915/1811] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:50.827960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dade12-7b29-4420-b216-0095455dce20 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:50.828716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dade12-7b29-4420-b216-0095455dce20 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:50.835244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dade12-7b29-4420-b216-0095455dce20 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:50.845885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 916/1812] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:36:50 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:50.846896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dade12-7b29-4420-b216-0095455dce20 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.855312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870c5ccd7a3a446aa1cac299df21dbcd', 'request_id': 'req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:50.877641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:50.889771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870c5ccd7a3a446aa1cac299df21dbcd', 'request_id': 'req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:50.911133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870c5ccd7a3a446aa1cac299df21dbcd', 'request_id': 'req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:50.964296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] The token cache is being invalidate because project 870c5ccd7a3a446aa1cac299df21dbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:50.968456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:50.971867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:50.984429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 897/1813] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:50 2022] DELETE /identity/v3/projects/870c5ccd7a3a446aa1cac299df21dbcd => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:50.988881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:50.999284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:51.012619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dade12-7b29-4420-b216-0095455dce20 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:51.019002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44288483-4031-4d65-a7e0-24138ea256e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:51.019964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288483-4031-4d65-a7e0-24138ea256e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:51.020391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288483-4031-4d65-a7e0-24138ea256e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:51.020605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44288483-4031-4d65-a7e0-24138ea256e1 admin admin] PATH_INFO: `/v3/projects/89f18220a9814c12a83c79500d53450b/users/6fd62ebb09be43088e482b97f139b600/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:51.030143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44288483-4031-4d65-a7e0-24138ea256e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f18220a9814c12a83c79500d53450b, user_id=6fd62ebb09be43088e482b97f139b600, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:51.032870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44288483-4031-4d65-a7e0-24138ea256e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:51.047252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbeacd-0d84-460e-8d8c-96b5492ddf77 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:51.052424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 917/1814] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:50 2022] PUT /identity/v3/projects/89f18220a9814c12a83c79500d53450b/users/6fd62ebb09be43088e482b97f139b600/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:51.062672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:51.062962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:51.063244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:51.119471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] MFA Rules not processed for user `6fd62ebb09be43088e482b97f139b600`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:51.121401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:51.272976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:51.278011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:51.278436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:51.279907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] PATH_INFO: `/v3/users/6d1646d7fcfe484bb84fa9d577100ae9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:51.281014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1646d7fcfe484bb84fa9d577100ae9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:51.288410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:51.325011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:51.386781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1646d7fcfe484bb84fa9d577100ae9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:51.400934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1646d7fcfe484bb84fa9d577100ae9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:51.405146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 918/1815] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:51.420840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:51.424502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:51.435493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1646d7fcfe484bb84fa9d577100ae9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:51.437388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1646d7fcfe484bb84fa9d577100ae9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:51.455391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-473a6f74-ef01-4ee5-9b85-c592861a7e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1646d7fcfe484bb84fa9d577100ae9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:51.471431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 898/1816] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:50 2022] DELETE /identity/v3/users/6d1646d7fcfe484bb84fa9d577100ae9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:51.502159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:51.502590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:51.503012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:51.547940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:51.550999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:51.565575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f8c2-0fa0-4e0c-95a4-f723cf1b21bd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:51.777789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:51.783764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:51.784736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:51.785197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:51.785625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:51.797295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:51.871223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 899/1817] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:51.872163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:51.880584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:52.042738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665337b0-9f7c-49f0-bfd6-00b02f32e160 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:52.050041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:52.051082 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:52.051666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:52.051988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] PATH_INFO: `/v3/users/fbd3581786964a719b4e3c0c19d72c66` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:52.053359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd3581786964a719b4e3c0c19d72c66)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:52.057116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:52.103675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:52.117846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:52.123049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96607705-6eb3-4acb-8763-f8e794b56e6f service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:52.158049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 919/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:52.160794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd3581786964a719b4e3c0c19d72c66'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:52.163129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0eda2-2cbf-402c-995b-84e5b91fb0ff None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:52.163459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0eda2-2cbf-402c-995b-84e5b91fb0ff None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:52.163820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0eda2-2cbf-402c-995b-84e5b91fb0ff None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:52.165448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 920/1819] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:36:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:36:52.176674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd3581786964a719b4e3c0c19d72c66'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:52.227438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd3581786964a719b4e3c0c19d72c66'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:52.228933 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd3581786964a719b4e3c0c19d72c66'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:52.275005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2cde455f-ea6f-4f41-a4c9-86f57c14ccbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd3581786964a719b4e3c0c19d72c66'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:52.289846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 900/1820] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:51 2022] DELETE /identity/v3/users/fbd3581786964a719b4e3c0c19d72c66 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:52.294391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:52.295111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:52.303364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:52.331430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:52.334371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:52.343300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:52.343595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:52.343946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:52.397961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:52.403080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:52.573664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 921/1821] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:52.600125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 901/1822] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:52.735811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:52.738889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:52.854970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce4a2c-5e26-4006-a56c-e14a52ee19e7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:52.865144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:52.866140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:52.866583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:52.867080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:52.884293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:52.886715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:52.904833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 922/1823] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:52.919622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:52.921702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:53.033443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488c127-6a2b-4e9f-b80a-8322ed4adddd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:53.040405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd62ebb09be43088e482b97f139b600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f18220a9814c12a83c79500d53450b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:53.041186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:53.041518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:53.041899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:53.042891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:53.043291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:53.047392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:53.067932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 902/1824] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:53.068922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:53.086385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f094-7484-41a4-a9c5-14e3fe101c8b service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:53.092510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd62ebb09be43088e482b97f139b600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f18220a9814c12a83c79500d53450b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:53.093288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:53.093649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:53.093994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:53.094847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:53.097020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:53.133173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 923/1825] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:53 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:53.137214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:53.144929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:53.149403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:53.153340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897ab4-1711-4cad-bd44-fab9e8a0e7c7 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:53.183633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:53.187900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:53.238261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd62ebb09be43088e482b97f139b600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f18220a9814c12a83c79500d53450b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:53.239710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:53.239710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:53.240184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:53.241186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:53.242016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:53.243795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:53.292978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 903/1826] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:53.327303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a39be-3473-4b80-a89a-e55c42616684 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:53.327666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:53.335802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:53.336892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:53.337297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:53.337868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:53.342173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:53.345600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f501cd-f18c-4603-b22c-d6773e07c4b4 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:53.352610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd62ebb09be43088e482b97f139b600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89f18220a9814c12a83c79500d53450b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:53.354340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:53.354799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:53.355255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] PATH_INFO: `/v3/projects/e0103aea0432453fac86150f1a8d3c46` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:53.358649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0103aea0432453fac86150f1a8d3c46)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:53.362248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:53.388548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:53.398886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:53.449545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 924/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:53.455777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0103aea0432453fac86150f1a8d3c46', 'request_id': 'req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:53.467795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0103aea0432453fac86150f1a8d3c46', 'request_id': 'req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:53.477704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0103aea0432453fac86150f1a8d3c46', 'request_id': 'req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:53.507976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] The token cache is being invalidate because project e0103aea0432453fac86150f1a8d3c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:53.508278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:53.517743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:53.519594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 904/1828] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:53 2022] DELETE /identity/v3/projects/e0103aea0432453fac86150f1a8d3c46 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:53.650557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:53.674059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a9bde-0e39-4954-b1e2-13530f82489a service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:53.781387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:53.782394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:53.785674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:53.786001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:53.789346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:53.811466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:53.813342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea1f29-62fc-407a-a9c3-b83f35e59a04 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:53.828013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 925/1829] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:53.905432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:53.907580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:54.069963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7aa50-d3f3-400f-a6b1-a9e1b070a714 tempest-VolumeQuotaClassesTest-1574623446 tempest-VolumeQuotaClassesTest-1574623446-project-admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:54.076692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:54.077904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:54.078348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:54.078785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] PATH_INFO: `/v3/users/93c1da48e6d240fe852672a8c31443ab` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:54.080267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c1da48e6d240fe852672a8c31443ab)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:54.082949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:54.180184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:54.191147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c1da48e6d240fe852672a8c31443ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:54.205573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c1da48e6d240fe852672a8c31443ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:54.229125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c1da48e6d240fe852672a8c31443ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:54.230143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c1da48e6d240fe852672a8c31443ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:54.239878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c1da48e6d240fe852672a8c31443ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:54.250888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 905/1830] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:53 2022] DELETE /identity/v3/users/93c1da48e6d240fe852672a8c31443ab => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:54.254116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:54.254503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:54.254861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:54.321039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:54.322622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:54.456011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 926/1831] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:54.664128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:54.665763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:54.761951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035013a3-6c23-4171-b5ae-c30ccd3427a2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:54.767097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:54.767928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:54.768439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:54.768795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:54.782731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:54.785145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:54.805965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 906/1832] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:54.977199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:54.979460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:54.999292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a981d72-b847-44e5-a9ba-ab6e8e9fc43c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:55.016528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:55.017598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:55.017991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:55.018334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:55.018999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] PATH_INFO: `/v3/projects/f3bcf11cac724055816b8b055ed628e2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:55.020014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bcf11cac724055816b8b055ed628e2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:55.021072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:55.024123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:55.080151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff843ff-1d78-4986-a383-7bade70ad331 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:55.085088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:55.095992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:55.100535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:55.100909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:55.101259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] PATH_INFO: `/v3/projects/c253533ea1bf42399a632ee8540a733d` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:55.102761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c253533ea1bf42399a632ee8540a733d)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:55.105767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:55.126615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bcf11cac724055816b8b055ed628e2', 'request_id': 'req-70820fa7-09de-4132-8e20-4b4d790ebd61'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.141081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bcf11cac724055816b8b055ed628e2', 'request_id': 'req-70820fa7-09de-4132-8e20-4b4d790ebd61'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.156071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bcf11cac724055816b8b055ed628e2', 'request_id': 'req-70820fa7-09de-4132-8e20-4b4d790ebd61'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.179545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] The token cache is being invalidate because project f3bcf11cac724055816b8b055ed628e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:55.180381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.181431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.183622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c253533ea1bf42399a632ee8540a733d', 'request_id': 'req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.186381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 927/1833] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:54 2022] DELETE /identity/v3/projects/f3bcf11cac724055816b8b055ed628e2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:55.190304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:55.192073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:55.195080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c253533ea1bf42399a632ee8540a733d', 'request_id': 'req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.205426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c253533ea1bf42399a632ee8540a733d', 'request_id': 'req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.224712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] The token cache is being invalidate because project c253533ea1bf42399a632ee8540a733d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:55.225148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.226419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.230762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 907/1834] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:55 2022] DELETE /identity/v3/projects/c253533ea1bf42399a632ee8540a733d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:55.236532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:55.239562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:55.330987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70820fa7-09de-4132-8e20-4b4d790ebd61 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:55.333097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:55.363322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89db1c-a9b3-4b68-a5e3-d17da6d0aa2d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:55.370455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:55.371561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:55.371967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:55.372518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] PATH_INFO: `/v3/users/35aa6c860b314cc894493b8141b1896e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:55.374560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35aa6c860b314cc894493b8141b1896e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:55.377412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:55.404593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:55.405862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:55.406148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:55.406424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] PATH_INFO: `/v3/users/31bec39d2c254a90953285e48fb7cce1` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:55.407698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bec39d2c254a90953285e48fb7cce1)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:55.410673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:55.449600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35aa6c860b314cc894493b8141b1896e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.461677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35aa6c860b314cc894493b8141b1896e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.478808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35aa6c860b314cc894493b8141b1896e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.479863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35aa6c860b314cc894493b8141b1896e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.490247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35aa6c860b314cc894493b8141b1896e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.494407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bec39d2c254a90953285e48fb7cce1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.501673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 908/1835] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:55 2022] DELETE /identity/v3/users/35aa6c860b314cc894493b8141b1896e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:55.507291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bec39d2c254a90953285e48fb7cce1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.519066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:55.534636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bec39d2c254a90953285e48fb7cce1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.535706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bec39d2c254a90953285e48fb7cce1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.551346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bec39d2c254a90953285e48fb7cce1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:55.562221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 928/1836] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:55 2022] DELETE /identity/v3/users/31bec39d2c254a90953285e48fb7cce1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:55.677620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:55.681122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:55.816959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742c456-1270-4bda-87a2-170e4eafd5a3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:55.965150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:55.966051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:55.966339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:55.966621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] PATH_INFO: `/v3/projects/502e573761004bdab0cde195ad537c45` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:55.968438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=502e573761004bdab0cde195ad537c45)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:55.970411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.043643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:56.088024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502e573761004bdab0cde195ad537c45', 'request_id': 'req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.097873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502e573761004bdab0cde195ad537c45', 'request_id': 'req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.104803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502e573761004bdab0cde195ad537c45', 'request_id': 'req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.117747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] The token cache is being invalidate because project 502e573761004bdab0cde195ad537c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:56.118939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.119885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.125486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 909/1837] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:55 2022] DELETE /identity/v3/projects/502e573761004bdab0cde195ad537c45 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:56.126435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.127932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.149913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cada88-34be-4fef-ba0c-e3b513215306 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.226330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.227327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.227711 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.228021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] PATH_INFO: `/v3/users/6fd62ebb09be43088e482b97f139b600` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.234473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd62ebb09be43088e482b97f139b600)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.240612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.266758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.268251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.294656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf94f4-65bf-4ebe-b7db-8a7f6436b28b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.314038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.315200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.315523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.315936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] PATH_INFO: `/v3/projects/66ab64774a054c12b464d18d28473c1d` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.317427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ab64774a054c12b464d18d28473c1d)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.324617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.365851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd62ebb09be43088e482b97f139b600'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.375442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd62ebb09be43088e482b97f139b600'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.400507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd62ebb09be43088e482b97f139b600'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.401435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd62ebb09be43088e482b97f139b600'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.411996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd62ebb09be43088e482b97f139b600'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.423959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 929/1838] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:36:56 2022] DELETE /identity/v3/users/6fd62ebb09be43088e482b97f139b600 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:56.424758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.426203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.440580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ab64774a054c12b464d18d28473c1d', 'request_id': 'req-56ef7893-a2e9-41a3-8e57-156b18e192de'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.465611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ab64774a054c12b464d18d28473c1d', 'request_id': 'req-56ef7893-a2e9-41a3-8e57-156b18e192de'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.475904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ab64774a054c12b464d18d28473c1d', 'request_id': 'req-56ef7893-a2e9-41a3-8e57-156b18e192de'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.494148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] The token cache is being invalidate because project 66ab64774a054c12b464d18d28473c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:56.494878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.496272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-56ef7893-a2e9-41a3-8e57-156b18e192de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.500002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 910/1839] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:56 2022] DELETE /identity/v3/projects/66ab64774a054c12b464d18d28473c1d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:36:56.505979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff894a7-64e2-4baa-a5e5-3c2382743545 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.506542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff894a7-64e2-4baa-a5e5-3c2382743545 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.507359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff894a7-64e2-4baa-a5e5-3c2382743545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.533933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2e366-2bda-4f0b-a8e2-9f89e920823e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.535055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-eff894a7-64e2-4baa-a5e5-3c2382743545 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:56.537142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eff894a7-64e2-4baa-a5e5-3c2382743545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.541215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.542308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.542657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.543070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] PATH_INFO: `/v3/projects/ed036fda46de4d9f999a27a5895e2e6b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.544741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed036fda46de4d9f999a27a5895e2e6b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.548087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.550294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:56.551597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 911/1840] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:36:56.563064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.564104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.564383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.598536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:56.600217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.613310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 912/1841] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:56.614877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.620832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed036fda46de4d9f999a27a5895e2e6b', 'request_id': 'req-6ec214dd-b558-415e-b310-ce4c16ce74c6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.627680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6223-301e-475d-937e-e4f603d752a8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.631127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed036fda46de4d9f999a27a5895e2e6b', 'request_id': 'req-6ec214dd-b558-415e-b310-ce4c16ce74c6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.638138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed036fda46de4d9f999a27a5895e2e6b', 'request_id': 'req-6ec214dd-b558-415e-b310-ce4c16ce74c6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.673731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] The token cache is being invalidate because project ed036fda46de4d9f999a27a5895e2e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:56.674024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.674710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ec214dd-b558-415e-b310-ce4c16ce74c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:56.677346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 930/1842] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:56 2022] DELETE /identity/v3/projects/ed036fda46de4d9f999a27a5895e2e6b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:56.683487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.683806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.684089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.706125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:56.707542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.724989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.727839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.728359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.728669 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.729576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:56.729889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.731906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.752161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 913/1843] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:56.757101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.759562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.780558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf12b51-ccb5-4ed9-b39e-cd3e4802d4cf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.787474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.788559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.788999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.789429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.790530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.792542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.798042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:56.849306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 931/1844] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:56.849521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 914/1845] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:56 2022] POST /identity/v3/projects => generated 399 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:56.853234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.855182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:56.858206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:56.880029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d52cd-cb5f-4b5c-948f-46ed51e890d6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.931702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc0710-ad5c-442c-be52-3de040c1e0c4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:56.939085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8b2a8-8827-4bce-a5b9-d0f1058ab052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.940295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8b2a8-8827-4bce-a5b9-d0f1058ab052 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.940588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8b2a8-8827-4bce-a5b9-d0f1058ab052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.940883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8b2a8-8827-4bce-a5b9-d0f1058ab052 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.941899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8b2a8-8827-4bce-a5b9-d0f1058ab052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.944098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8b2a8-8827-4bce-a5b9-d0f1058ab052 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.978631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:56.978631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.978631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.978631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] PATH_INFO: `/v3/projects/89f18220a9814c12a83c79500d53450b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:56.979096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f18220a9814c12a83c79500d53450b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:56.979096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:56.983477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 915/1846] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:56 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:56.984710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:56.985005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:56.985286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.008821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:57.010281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.022483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 916/1847] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:57.022691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:57.025467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.040299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f18220a9814c12a83c79500d53450b', 'request_id': 'req-cd51be63-43fc-416e-890b-75f7397aaa48'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:57.045551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0d25-cb98-4661-9548-92ff752e6431 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.051386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f18220a9814c12a83c79500d53450b', 'request_id': 'req-cd51be63-43fc-416e-890b-75f7397aaa48'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:57.059489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f18220a9814c12a83c79500d53450b', 'request_id': 'req-cd51be63-43fc-416e-890b-75f7397aaa48'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:57.083143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] The token cache is being invalidate because project 89f18220a9814c12a83c79500d53450b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:36:57.083753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:57.084592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:36:57.086681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 932/1848] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:36:56 2022] DELETE /identity/v3/projects/89f18220a9814c12a83c79500d53450b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:57.087798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.089603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.112676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f45ec-07b9-4f93-ba58-844e635e990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.113408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f45ec-07b9-4f93-ba58-844e635e990a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.113721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f45ec-07b9-4f93-ba58-844e635e990a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.114472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f45ec-07b9-4f93-ba58-844e635e990a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.114844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f45ec-07b9-4f93-ba58-844e635e990a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.116663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f45ec-07b9-4f93-ba58-844e635e990a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.128828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 917/1849] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.130229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.130529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.130813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.149931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:57.151180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.160024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 918/1850] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:57.161048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.162449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.173951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51be63-43fc-416e-890b-75f7397aaa48 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.175139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b249f-4dfe-4dd9-905e-92aa1b7c5174 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.178669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.179402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.179689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.179817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.180041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.180421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.180711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.180816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:57.180988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.181088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.181722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.182730 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a88e5-5a72-45b3-bb68-86eff740bf96 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.183331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.195919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 933/1851] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:57.197273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.197657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.197785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 919/1852] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.197879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.200859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.210962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3806-4afb-4da8-a8c7-5883ef95283f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.215788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.215977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:57.216473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.216790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.217068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.217230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.217758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.219768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.225387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 934/1853] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:57.226216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.236364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d544bd9-838e-4c23-8a87-7583b2afb5e2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.241271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.242166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.242451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.242726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] PATH_INFO: `/v3/projects/4242ceb48f904ff583844062c2f09cbb/users/43a278070c4a43909d34a3bc3f1da1bd/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.250943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 920/1854] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:36:57.250943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.258815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4242ceb48f904ff583844062c2f09cbb, user_id=43a278070c4a43909d34a3bc3f1da1bd, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.262217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.277518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 935/1855] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:57 2022] PUT /identity/v3/projects/4242ceb48f904ff583844062c2f09cbb/users/43a278070c4a43909d34a3bc3f1da1bd/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:57.280590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.284399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:57.320548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c92421-ea7d-420b-be6f-29c616b6fc5d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.352662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498fd7-6a1a-4930-8ea4-48c4d73abaf5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.357921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d37f2-1d02-4fb3-a853-2b44d6a7d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.358616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d37f2-1d02-4fb3-a853-2b44d6a7d555 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.358899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d37f2-1d02-4fb3-a853-2b44d6a7d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.359179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d37f2-1d02-4fb3-a853-2b44d6a7d555 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.359940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d37f2-1d02-4fb3-a853-2b44d6a7d555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.361873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d37f2-1d02-4fb3-a853-2b44d6a7d555 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.384134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.384859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.385168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.385444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.386209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:36:57.386522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.387250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 936/1856] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:57.389646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.390448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.391076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.392976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.402552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 921/1857] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:36:57.403361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.415078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3bdb5-d8d8-4883-9138-d50ccc69e887 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.423151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.424062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.424532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.424814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.425602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.427425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.439368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:57.444744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 922/1858] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.444744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.447552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] MFA Rules not processed for user `43a278070c4a43909d34a3bc3f1da1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:57.449432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.457769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea64f4-3087-4910-a92e-d585803685eb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.463200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.464051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.464414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.464789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.465558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.468139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.502614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 923/1859] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/projects => generated 407 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:57.503663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.547899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 937/1860] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:57.549788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.565808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052eb3-9070-44c8-8481-d32d48645138 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.578337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9a5d-12c2-41e3-9fe1-ede9fce7d8fe admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.584314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.585174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.585550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.585750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.586481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.588169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.599489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 924/1861] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.603480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.614854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a57b6-427a-444e-8610-3655e59770ea admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.620453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.621392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.621743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.622371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.622946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.624976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.636118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.636815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.637114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.637387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.638194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.640429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.661384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 925/1862] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:57.662328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.668633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 938/1863] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/users => generated 304 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:57.669762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.681069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7752bd8-251d-4841-9a1d-fc55940e0921 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.682113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:57.747386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922765-f32e-4fec-8119-136b11cf016e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.754833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.755821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.756051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.756327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] PATH_INFO: `/v3/projects/2ec0448b95104694ad38ea2b01f7c888/users/1ffa5c8a92d34c73b919cfac0a9122b1/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.780488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec0448b95104694ad38ea2b01f7c888, user_id=1ffa5c8a92d34c73b919cfac0a9122b1, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.783174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.790469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f0183-57bc-4f28-a5b1-a8fcc3613a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.791179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f0183-57bc-4f28-a5b1-a8fcc3613a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.791448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f0183-57bc-4f28-a5b1-a8fcc3613a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.792113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f0183-57bc-4f28-a5b1-a8fcc3613a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.792454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f0183-57bc-4f28-a5b1-a8fcc3613a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.794391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f0183-57bc-4f28-a5b1-a8fcc3613a6a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.828631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 926/1864] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:57 2022] PUT /identity/v3/projects/2ec0448b95104694ad38ea2b01f7c888/users/1ffa5c8a92d34c73b919cfac0a9122b1/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:57.828631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.838835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 939/1865] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/users => generated 307 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:57.838835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.838835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.838835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.870821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] MFA Rules not processed for user `1ffa5c8a92d34c73b919cfac0a9122b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:57.872157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:57.883974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:57.915523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726178a9-3052-4654-9cc8-9f7e7d3f40bc admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.916659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.917340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.917630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.917909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.918647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.920938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.931604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 927/1866] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.932538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.943487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35460733-1687-4664-8a8f-05691ec70880 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.948665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.949340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.949624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.949897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.950629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.952356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.962895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 928/1867] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.963896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.965917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 940/1868] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:57.967330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:57.974038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2afd-3bb2-4a78-8109-c5c4ac114491 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.977971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4e92-a36c-4c2e-bf25-2046df1d6048 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:57.978986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.979643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.979976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.980258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.981029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:57.983178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:57.984557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:57.985636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:57.986082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:57.986515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] PATH_INFO: `/v3/projects/b0d007a1f7c54cb6b229cb828374e431/users/64efd47746b44310ba38524ec759e8f4/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:57.998903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 929/1869] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:57.998903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.007803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d007a1f7c54cb6b229cb828374e431, user_id=64efd47746b44310ba38524ec759e8f4, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.009707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600332b-4c41-4ce2-867f-21170427f408 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.010767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.014697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.015443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.015782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.016071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.017019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.019604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.031948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 941/1870] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:57 2022] PUT /identity/v3/projects/b0d007a1f7c54cb6b229cb828374e431/users/64efd47746b44310ba38524ec759e8f4/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:36:58.032877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.050977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 930/1871] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:57 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:58.051569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.110949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:58.113902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4cc12-b743-41e2-bff8-89d4b36732c3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.154452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3349-f3d1-42b4-89b4-e2ac1e58bda9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.162904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.164426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.172429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.172851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.173648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.175277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.181473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.182597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.182809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.183093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] PATH_INFO: `/v3/projects/a16410c92c32415b8e550e37d3625c0c/users/1ac530bb0c0240f7b711c726d47be6f9/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.198108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 931/1872] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:58.198108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.205870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16410c92c32415b8e550e37d3625c0c, user_id=1ac530bb0c0240f7b711c726d47be6f9, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.208794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.208993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda7ab-e6e6-4dae-ad2c-52212e38d4bf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.221531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327268dc-fe4e-4a69-89ba-6ac6a5cebf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.222289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327268dc-fe4e-4a69-89ba-6ac6a5cebf01 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.222581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327268dc-fe4e-4a69-89ba-6ac6a5cebf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.222857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327268dc-fe4e-4a69-89ba-6ac6a5cebf01 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.224452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327268dc-fe4e-4a69-89ba-6ac6a5cebf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.226413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327268dc-fe4e-4a69-89ba-6ac6a5cebf01 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.229060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 942/1873] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:58 2022] PUT /identity/v3/projects/a16410c92c32415b8e550e37d3625c0c/users/1ac530bb0c0240f7b711c726d47be6f9/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:58.236661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.258584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 932/1874] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:58 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:58.258584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ccc2-baea-4149-a5c2-dff1b7daed2c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.258584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ccc2-baea-4149-a5c2-dff1b7daed2c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.258584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ccc2-baea-4149-a5c2-dff1b7daed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.261833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:58.288966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3d44ccc2-baea-4149-a5c2-dff1b7daed2c None None] MFA Rules not processed for user `1ac530bb0c0240f7b711c726d47be6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:58.290349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d44ccc2-baea-4149-a5c2-dff1b7daed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:58.322439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa494e0-f482-4929-b2d5-87180e989e49 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.328357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.329270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.329550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.329861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] PATH_INFO: `/v3/projects/b0d007a1f7c54cb6b229cb828374e431/users/64efd47746b44310ba38524ec759e8f4/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.332563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d007a1f7c54cb6b229cb828374e431, user_id=64efd47746b44310ba38524ec759e8f4, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.335981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.348353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 943/1875] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:58 2022] PUT /identity/v3/projects/b0d007a1f7c54cb6b229cb828374e431/users/64efd47746b44310ba38524ec759e8f4/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:58.359182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.367086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 933/1876] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:58.368698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.369099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.369464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.404136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] MFA Rules not processed for user `64efd47746b44310ba38524ec759e8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:58.406570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:58.427101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc03b8f-0377-4fd9-9e54-626ccc69ae66 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.432066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.432888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.433195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.433482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.434220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.436427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.468869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 944/1877] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:58.469843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.486777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d99d8-c9f0-4316-b0bb-d24c99a0b3da admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.502866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.504766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.505062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.505344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.506936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.511131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.593612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 945/1878] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:36:58 2022] POST /identity/v3/projects => generated 409 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:58.593612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.602468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 934/1879] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:58.604012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.625267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c446-52fb-48c2-86a7-e02c90ba44fe None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.697525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:58.707587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e6b62-f0c3-44d9-aafa-0653035a60df admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.713705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.715961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.716247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.716344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] PATH_INFO: `/v3/projects/baba1aadac7e458b8e1bd159d5b4dbaf/users/a12aa420955c49248a7c98bdadadb83b/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.734915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=baba1aadac7e458b8e1bd159d5b4dbaf, user_id=a12aa420955c49248a7c98bdadadb83b, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.737965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.743976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.745443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.745771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.746112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.747581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.750450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.755823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 946/1880] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:58 2022] PUT /identity/v3/projects/baba1aadac7e458b8e1bd159d5b4dbaf/users/a12aa420955c49248a7c98bdadadb83b/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:58.756892 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.760046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:58.776147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:58.787026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 935/1881] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:36:58 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:36:58.788227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.803753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97610012-7b8f-4ae9-b6f8-e059257cb68f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.844687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6b5b2-69d4-46fc-9703-b7ec1ddd88bc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.848838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe7c1d-eb4d-475f-9ff2-062e9134de27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.849802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe7c1d-eb4d-475f-9ff2-062e9134de27 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.850862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe7c1d-eb4d-475f-9ff2-062e9134de27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.851412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe7c1d-eb4d-475f-9ff2-062e9134de27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.872153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.873989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.874651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.875415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.876591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.879217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.904737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 936/1882] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:58.904737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.913441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8769c-1b19-47ab-b759-9841dd11f03f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.921125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.921871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.922292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.923075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.924209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.925496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.950639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 937/1883] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:58.950639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:58.962741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa9e3-a02f-40a1-944d-eb0ff5b54e8a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:58.969837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:58.970850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:58.971140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:58.971450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] PATH_INFO: `/v3/projects/baba1aadac7e458b8e1bd159d5b4dbaf/users/a12aa420955c49248a7c98bdadadb83b/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:58.973885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe7c1d-eb4d-475f-9ff2-062e9134de27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.975632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=baba1aadac7e458b8e1bd159d5b4dbaf, user_id=a12aa420955c49248a7c98bdadadb83b, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:58.976922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe7c1d-eb4d-475f-9ff2-062e9134de27 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.978727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:58.992304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 938/1884] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:58 2022] PUT /identity/v3/projects/baba1aadac7e458b8e1bd159d5b4dbaf/users/a12aa420955c49248a7c98bdadadb83b/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:58.993147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:59.004287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 947/1885] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:59.006085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.006381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.006664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.045038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] MFA Rules not processed for user `a12aa420955c49248a7c98bdadadb83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:59.046256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:59.129167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e179-0cfc-421a-92e5-ab0329052fdb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:59.135607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:59.137017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.137403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.138022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] PATH_INFO: `/v3/projects/839e75e4ae34409ab260013680747b1b/users/a0b083d8a80c4fc9a1092c1f2b794fa2/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.158234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839e75e4ae34409ab260013680747b1b, user_id=a0b083d8a80c4fc9a1092c1f2b794fa2, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:59.161446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:59.175348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 948/1886] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:36:59.176456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:59.190057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 939/1887] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:58 2022] PUT /identity/v3/projects/839e75e4ae34409ab260013680747b1b/users/a0b083d8a80c4fc9a1092c1f2b794fa2/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:36:59.191135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:59.193428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:59.229009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:59.284865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:59.300114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10dba0-813c-4665-b61c-7afeedbe7017 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:59.325553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5b3ca-c8ad-4a56-be41-5fc852494bc4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:59.335250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:59.336194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.336656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.337207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.397348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:59.398503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.398956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.399417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.458821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:59.460528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:59.476217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 940/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:59.477253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:59.571534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:59.573645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:59.604632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 949/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:36:59.611074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:59.624145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce01f47-5d25-40b1-b581-c54899f85977 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:59.625342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602ecd-d362-448f-b9dc-fd3c1b5d2b3a service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:59.630996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:59.631792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.632142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.632514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.641445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:59.642151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.642422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.642750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.643498 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:59.646089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:59.673326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 941/1890] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:36:59.677788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:36:59.710621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144655a-9bfd-43f8-8630-9b6e1202df2a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:36:59.716417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3932-d9dd-4c13-8a56-7703c550b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:36:59.717521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3932-d9dd-4c13-8a56-7703c550b2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.717825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3932-d9dd-4c13-8a56-7703c550b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.718112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3932-d9dd-4c13-8a56-7703c550b2fe admin admin] PATH_INFO: `/v3/projects/839e75e4ae34409ab260013680747b1b/users/a0b083d8a80c4fc9a1092c1f2b794fa2/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.722943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3932-d9dd-4c13-8a56-7703c550b2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=839e75e4ae34409ab260013680747b1b, user_id=a0b083d8a80c4fc9a1092c1f2b794fa2, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:59.727481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3932-d9dd-4c13-8a56-7703c550b2fe admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:59.765633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:36:59.767751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:36:59.770701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 942/1891] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:36:59 2022] PUT /identity/v3/projects/839e75e4ae34409ab260013680747b1b/users/a0b083d8a80c4fc9a1092c1f2b794fa2/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:36:59.782241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:36:59.782711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:36:59.783626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:36:59.809806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 950/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:36:59.853801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] MFA Rules not processed for user `a0b083d8a80c4fc9a1092c1f2b794fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:36:59.855101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:36:59.929323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:59.974148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 943/1893] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:00.134956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:00.144982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af4e5-5b9b-4587-9792-48f33d70b5ad service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:00.265359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedcb50-49dc-4d40-8e92-b7ee88b5e46a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:00.266426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcb50-49dc-4d40-8e92-b7ee88b5e46a service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:00.268876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcb50-49dc-4d40-8e92-b7ee88b5e46a service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:00.270390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcb50-49dc-4d40-8e92-b7ee88b5e46a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:00.291849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:00.303769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedcb50-49dc-4d40-8e92-b7ee88b5e46a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:00.303769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedcb50-49dc-4d40-8e92-b7ee88b5e46a service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:00.342159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 951/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:00.667029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:00.683252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a8f22-c1c6-412c-a28a-d7ae3d6f592e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:00.696602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f31f8-9410-4a64-ae21-fb65fce71b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:00.697453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f31f8-9410-4a64-ae21-fb65fce71b60 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:00.697808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f31f8-9410-4a64-ae21-fb65fce71b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:00.698172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f31f8-9410-4a64-ae21-fb65fce71b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:00.777327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f31f8-9410-4a64-ae21-fb65fce71b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:00.779536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f31f8-9410-4a64-ae21-fb65fce71b60 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:00.793699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 944/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:00.839257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09bc4-a448-4a92-8c8e-93fdd5e9933d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:00.839560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09bc4-a448-4a92-8c8e-93fdd5e9933d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:00.839878 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09bc4-a448-4a92-8c8e-93fdd5e9933d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:00.841543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 952/1896] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:37:00.850173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:00.850478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:00.850785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:00.876087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:00.877399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:01.042046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 945/1897] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:01.118120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09bc4-a448-4a92-8c8e-93fdd5e9933d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:01.120168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4f09bc4-a448-4a92-8c8e-93fdd5e9933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:01.161258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09bc4-a448-4a92-8c8e-93fdd5e9933d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:01.178503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef83008-d09d-4de2-a8cc-fb1d3d9ca9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:01.179911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83008-d09d-4de2-a8cc-fb1d3d9ca9a8 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:01.181528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83008-d09d-4de2-a8cc-fb1d3d9ca9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:01.181652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef83008-d09d-4de2-a8cc-fb1d3d9ca9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:01.209293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef83008-d09d-4de2-a8cc-fb1d3d9ca9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:01.215982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef83008-d09d-4de2-a8cc-fb1d3d9ca9a8 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:01.246132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 953/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:04.382857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:04.479042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57c95b-d238-4fca-b7a9-78056bb3a1fd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:04.486925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:04.488211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:04.488211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:04.488563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] PATH_INFO: `/v3/users/43a278070c4a43909d34a3bc3f1da1bd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:04.490189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a278070c4a43909d34a3bc3f1da1bd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:04.492216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:04.507997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:04.553315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a278070c4a43909d34a3bc3f1da1bd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:04.564431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a278070c4a43909d34a3bc3f1da1bd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:04.578530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a278070c4a43909d34a3bc3f1da1bd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:04.579231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a278070c4a43909d34a3bc3f1da1bd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:04.586387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a278070c4a43909d34a3bc3f1da1bd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:04.593470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 946/1899] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:04 2022] DELETE /identity/v3/users/43a278070c4a43909d34a3bc3f1da1bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:04.598023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:04.598496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:04.598581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:04.619389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:04.620851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:04.764491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 954/1900] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:04.775292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:04.777107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:04.869508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b638be-9244-484a-996f-c525d35620ae admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:04.873993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:04.874858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:04.875335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:04.875690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:04.888988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:04.892208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:04.903110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 947/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:05.509659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:05.511591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:05.521375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:05.522866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:05.526981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ba00-b075-43d9-a14a-6fa100c8cde1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:05.534119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:05.535027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:05.535761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:05.536197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] PATH_INFO: `/v3/users/1ffa5c8a92d34c73b919cfac0a9122b1` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:05.537985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffa5c8a92d34c73b919cfac0a9122b1)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:05.539640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:05.557545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567cfff-e1db-48df-b68d-c7971d4de882 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:05.563166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:05.564128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:05.564416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:05.564685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] PATH_INFO: `/v3/projects/4242ceb48f904ff583844062c2f09cbb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:05.577047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4242ceb48f904ff583844062c2f09cbb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:05.578994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:05.597311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffa5c8a92d34c73b919cfac0a9122b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.605971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffa5c8a92d34c73b919cfac0a9122b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.619573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffa5c8a92d34c73b919cfac0a9122b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.620353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffa5c8a92d34c73b919cfac0a9122b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.637430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-22f29229-0df1-4b1b-85ca-ff2923702ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffa5c8a92d34c73b919cfac0a9122b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.645305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 955/1902] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:05 2022] DELETE /identity/v3/users/1ffa5c8a92d34c73b919cfac0a9122b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:05.649313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:05.649605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:05.649890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:05.652019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4242ceb48f904ff583844062c2f09cbb', 'request_id': 'req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.660290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4242ceb48f904ff583844062c2f09cbb', 'request_id': 'req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.667131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4242ceb48f904ff583844062c2f09cbb', 'request_id': 'req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.670448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:05.671871 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:05.683273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] The token cache is being invalidate because project 4242ceb48f904ff583844062c2f09cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:05.683977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.685120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.687011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 948/1903] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:05 2022] DELETE /identity/v3/projects/4242ceb48f904ff583844062c2f09cbb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:05.690703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:05.692122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:05.741616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:05.742676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:05.763666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 956/1904] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:05.774880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:05.776971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:05.833713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8f666-b1e7-4c1f-bd7a-cdec8d9a70eb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:05.839461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:05.840693 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:05.841083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:05.841503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] PATH_INFO: `/v3/users/64efd47746b44310ba38524ec759e8f4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:05.843155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64efd47746b44310ba38524ec759e8f4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:05.845137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:05.848060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2981b1-7f77-460b-b559-5d24ac0b4865 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:05.870527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:05.872135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:05.872670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:05.872961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:05.897876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:05.899490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:05.910158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64efd47746b44310ba38524ec759e8f4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.913063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 957/1905] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:05.923523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64efd47746b44310ba38524ec759e8f4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.940060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64efd47746b44310ba38524ec759e8f4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.940926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64efd47746b44310ba38524ec759e8f4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.948614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64efd47746b44310ba38524ec759e8f4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:05.955437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:05 2022] DELETE /identity/v3/users/64efd47746b44310ba38524ec759e8f4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:06.610745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:06.612822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:06.631919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8daadc-a68f-4876-b272-8a35659c135f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:06.727756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:06.743270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:06.759062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:06.760053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:06.760361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:06.760641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] PATH_INFO: `/v3/projects/2ec0448b95104694ad38ea2b01f7c888` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:06.762903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec0448b95104694ad38ea2b01f7c888)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:06.765126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:06.873925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec0448b95104694ad38ea2b01f7c888', 'request_id': 'req-c3724a16-cb58-446e-b47b-b9ae0afaaa07'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:06.890242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec0448b95104694ad38ea2b01f7c888', 'request_id': 'req-c3724a16-cb58-446e-b47b-b9ae0afaaa07'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:06.904515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1460e-4be5-4e62-b675-ad6da5b6d262 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:06.906136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec0448b95104694ad38ea2b01f7c888', 'request_id': 'req-c3724a16-cb58-446e-b47b-b9ae0afaaa07'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:06.926846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] The token cache is being invalidate because project 2ec0448b95104694ad38ea2b01f7c888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:06.927307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:06.928554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:06.948361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 958/1907] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:06 2022] DELETE /identity/v3/projects/2ec0448b95104694ad38ea2b01f7c888 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:06.953279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:06.957322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:06.973760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:07.010643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.012117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.012587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.013061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:07.014576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] PATH_INFO: `/v3/projects/b0d007a1f7c54cb6b229cb828374e431` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.016829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d007a1f7c54cb6b229cb828374e431)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.019282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.065775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724a16-cb58-446e-b47b-b9ae0afaaa07 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.071325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.072600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.072930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.073274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] PATH_INFO: `/v3/users/a12aa420955c49248a7c98bdadadb83b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.074844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12aa420955c49248a7c98bdadadb83b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.077757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.125193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d007a1f7c54cb6b229cb828374e431', 'request_id': 'req-27dc79af-2dea-4006-9c96-ec26312650ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.136228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d007a1f7c54cb6b229cb828374e431', 'request_id': 'req-27dc79af-2dea-4006-9c96-ec26312650ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.145062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12aa420955c49248a7c98bdadadb83b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.146177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d007a1f7c54cb6b229cb828374e431', 'request_id': 'req-27dc79af-2dea-4006-9c96-ec26312650ab'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.158030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12aa420955c49248a7c98bdadadb83b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.161637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] The token cache is being invalidate because project b0d007a1f7c54cb6b229cb828374e431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:07.162175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.163144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.164996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 950/1908] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:06 2022] DELETE /identity/v3/projects/b0d007a1f7c54cb6b229cb828374e431 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:07.166206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.167861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.179802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12aa420955c49248a7c98bdadadb83b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.180588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12aa420955c49248a7c98bdadadb83b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.189276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a6e78f3d-e57e-4b31-91a8-60e7ad4d6f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12aa420955c49248a7c98bdadadb83b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.197908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 959/1909] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:06 2022] DELETE /identity/v3/users/a12aa420955c49248a7c98bdadadb83b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:07.199253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da68a8-2b25-44ab-87dc-f5f4f984e363 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.199543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da68a8-2b25-44ab-87dc-f5f4f984e363 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.199854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da68a8-2b25-44ab-87dc-f5f4f984e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.222186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-52da68a8-2b25-44ab-87dc-f5f4f984e363 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:07.223495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-52da68a8-2b25-44ab-87dc-f5f4f984e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.291358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc79af-2dea-4006-9c96-ec26312650ab admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.346213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 960/1910] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:07.349219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.349503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.349882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.383419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:07.386213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.386926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.388197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.388531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.388945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] PATH_INFO: `/v3/users/1ac530bb0c0240f7b711c726d47be6f9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.390591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac530bb0c0240f7b711c726d47be6f9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.393050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.414606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 961/1911] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:07.415768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.422463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:07.434910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be6df7-bff6-4de7-b314-e8ba9418f2ae None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.441195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.441880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.442167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.442445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.443185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:07.443494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.445175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.463846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 962/1912] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:07.464810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.466950 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac530bb0c0240f7b711c726d47be6f9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.477012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c8000-eb5e-4d7d-af64-c0377c51ef02 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.480738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac530bb0c0240f7b711c726d47be6f9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.489663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.490355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.490639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.490920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.491634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.494337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.511885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac530bb0c0240f7b711c726d47be6f9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.516786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac530bb0c0240f7b711c726d47be6f9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.525457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-548cb697-647d-4126-a9cc-a3167723dd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac530bb0c0240f7b711c726d47be6f9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.539430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 951/1913] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:07 2022] DELETE /identity/v3/users/1ac530bb0c0240f7b711c726d47be6f9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:07.547461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.549011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.549656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.560330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 963/1914] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:07 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:07.564881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.570574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.598799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:07.601542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:07.603151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.724117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d843e26-87ba-4c91-a8e5-f226d3b80d41 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.732696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.734758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.735297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.735812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.736880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.740007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.750225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 952/1915] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:07.764386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.765866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.770091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 964/1916] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:07 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:07.774845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.785469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f581d3-4d96-4d99-bd8e-9a149e83c356 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.796487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dc2dd-6ea4-4d7d-8fa7-c46dc301f1f9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.800125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.801515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.801658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.801889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.802108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] PATH_INFO: `/v3/projects/baba1aadac7e458b8e1bd159d5b4dbaf` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.802522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.802874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.803219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.803385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baba1aadac7e458b8e1bd159d5b4dbaf)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.804282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:07.805424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.806139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:07.821779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 965/1917] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:07.821779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.821779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.864284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baba1aadac7e458b8e1bd159d5b4dbaf', 'request_id': 'req-dc7009d4-fc50-4cda-9afd-07c8f13f9742'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.873395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baba1aadac7e458b8e1bd159d5b4dbaf', 'request_id': 'req-dc7009d4-fc50-4cda-9afd-07c8f13f9742'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.881004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baba1aadac7e458b8e1bd159d5b4dbaf', 'request_id': 'req-dc7009d4-fc50-4cda-9afd-07c8f13f9742'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.894652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] The token cache is being invalidate because project baba1aadac7e458b8e1bd159d5b4dbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:07.895210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.896831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:07.898725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 953/1918] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:07 2022] DELETE /identity/v3/projects/baba1aadac7e458b8e1bd159d5b4dbaf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:07.899362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:07.901505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:07.904970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa75b63-159d-4600-a4c3-df07c7ae4e33 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:07.933913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:07.974261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:07.975009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:07.975203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:07.975484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:07.977428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:08.004386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7009d4-fc50-4cda-9afd-07c8f13f9742 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.016582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a29add-46b0-4909-a7d0-7190aaff52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.018070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a29add-46b0-4909-a7d0-7190aaff52f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.018471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a29add-46b0-4909-a7d0-7190aaff52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.020030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a29add-46b0-4909-a7d0-7190aaff52f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.021323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a29add-46b0-4909-a7d0-7190aaff52f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.028036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a29add-46b0-4909-a7d0-7190aaff52f5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.048270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 954/1919] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:08.048270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.048270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.048270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.060963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:08.069703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:08.071293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:08.074782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.076956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae7975-4728-4e15-b938-0d2fdc6e93c7 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.084469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 955/1920] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:08.091326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.091977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 966/1921] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:08.094274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.094811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.095100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.097048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b1865-6b49-4457-abb4-10d589618827 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.103692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2e780-69b1-4fc5-980a-427444961452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.103692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e780-69b1-4fc5-980a-427444961452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.103978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e780-69b1-4fc5-980a-427444961452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.104186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e780-69b1-4fc5-980a-427444961452 admin admin] PATH_INFO: `/v3/projects/73db487a8d284d6ba4eff8fc504253f5/users/d03df4f45ac7439b8a478930d7f59d9b/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.115822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:08.116972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:08.120028 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2e780-69b1-4fc5-980a-427444961452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73db487a8d284d6ba4eff8fc504253f5, user_id=d03df4f45ac7439b8a478930d7f59d9b, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.124786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2e780-69b1-4fc5-980a-427444961452 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.128297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 967/1922] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:08.133003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.144406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51935f-35fd-43ec-93e3-865863f63430 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.145839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 956/1923] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:08 2022] PUT /identity/v3/projects/73db487a8d284d6ba4eff8fc504253f5/users/d03df4f45ac7439b8a478930d7f59d9b/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:08.157305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.157305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.157583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.189302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] MFA Rules not processed for user `d03df4f45ac7439b8a478930d7f59d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:08.192224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:08.221980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.222764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.223202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.223545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.224375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:08.224743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.226463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.244104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 968/1924] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:08.248426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.267288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0582f1d-bd2c-4122-9056-eb9e1767293e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.275264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.276367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.277301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.277733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.278624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.281753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.318883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 957/1925] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:08.319938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.350272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 969/1926] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:08.353769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.363105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cdc36-2a64-46c0-9130-eb884a7ce3cb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.480752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.481431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.482585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.482813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.483547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.487541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.507760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1907bd-0c4b-461b-9dba-4ad3798c4836 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.522546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 958/1927] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:08.528416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.537576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:08.628802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.629612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.629999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.630377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.631180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.633377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.636590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd4c43-631e-4256-ae96-73a179a5a629 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.646337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.647292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:08.647918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.648382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.648944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.649846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.668264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 970/1928] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/users => generated 280 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:08.672704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.672899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.703385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180be59-c627-4944-b1c7-d042e1a0da65 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.718350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 959/1929] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:08.723128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.723276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.723388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.723665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.723972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.724716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.726346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.737528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e32bb-96a5-4f44-a3c6-9b2d2a01c2bf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.750093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 971/1930] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:08.754299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.758207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.759073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.759273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.759455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.760233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.761860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.772008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f553aab-f5a5-451d-a65a-13291f390db9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.778712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.780336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.780839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.781323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.782287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.784506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.787789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 960/1931] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:08.788895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.799954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2eae9-efb8-499a-a5b9-5dc067e72477 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.804952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.808755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.808755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.808755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.808755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.810050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 972/1932] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:08.811093 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.811855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.827311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 961/1933] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:08.828502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.831417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6e345-4f00-4ee4-be85-7e69c0ace163 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.839546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd4d9-0a60-4619-b188-6fc1d4589f4c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:08.839840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df3ead-4537-487b-a42c-b9b62507fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.842473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df3ead-4537-487b-a42c-b9b62507fcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.842767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df3ead-4537-487b-a42c-b9b62507fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.843149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df3ead-4537-487b-a42c-b9b62507fcd4 admin admin] PATH_INFO: `/v3/projects/5e70624385e448fe9b2af39f65daba50/users/f5548f9ff67d47d48a6fcc22a8d29329/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.856643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:08.859142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.859957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.861353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] PATH_INFO: `/v3/projects/10af70b2f5a84e7a850c3596122ccc6d/users/d58343598cf54cf7bb30087afb093a2c/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.862348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df3ead-4537-487b-a42c-b9b62507fcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e70624385e448fe9b2af39f65daba50, user_id=f5548f9ff67d47d48a6fcc22a8d29329, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.865329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df3ead-4537-487b-a42c-b9b62507fcd4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.883511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 973/1934] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:08 2022] PUT /identity/v3/projects/5e70624385e448fe9b2af39f65daba50/users/f5548f9ff67d47d48a6fcc22a8d29329/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:08.884882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=10af70b2f5a84e7a850c3596122ccc6d, user_id=d58343598cf54cf7bb30087afb093a2c, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:08.894922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51521-1b5c-47f3-8966-bc7fa6a5c6d3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:08.895216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51521-1b5c-47f3-8966-bc7fa6a5c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:08.895501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51521-1b5c-47f3-8966-bc7fa6a5c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:08.916619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:08.938543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a0c51521-1b5c-47f3-8966-bc7fa6a5c6d3 None None] MFA Rules not processed for user `f5548f9ff67d47d48a6fcc22a8d29329`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:08.940574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a0c51521-1b5c-47f3-8966-bc7fa6a5c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:08.942053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 962/1935] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:08 2022] PUT /identity/v3/projects/10af70b2f5a84e7a850c3596122ccc6d/users/d58343598cf54cf7bb30087afb093a2c/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:08.943145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:08.945398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.082199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 974/1936] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:09.085708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.086097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.086384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.090197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972ce4-31a2-4200-ae57-14be6093b2be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.096514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.097776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.098723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.098723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] PATH_INFO: `/v3/projects/a16410c92c32415b8e550e37d3625c0c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.100141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16410c92c32415b8e550e37d3625c0c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.102979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.147580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] MFA Rules not processed for user `d58343598cf54cf7bb30087afb093a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:09.149367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.172094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:09.173655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16410c92c32415b8e550e37d3625c0c', 'request_id': 'req-73666151-1c8f-4038-98ff-80a67bae5ea7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.186633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16410c92c32415b8e550e37d3625c0c', 'request_id': 'req-73666151-1c8f-4038-98ff-80a67bae5ea7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.199773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16410c92c32415b8e550e37d3625c0c', 'request_id': 'req-73666151-1c8f-4038-98ff-80a67bae5ea7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.219681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] The token cache is being invalidate because project a16410c92c32415b8e550e37d3625c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:09.220029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.220923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.226554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 963/1937] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:08 2022] DELETE /identity/v3/projects/a16410c92c32415b8e550e37d3625c0c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:09.227675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.229296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.285889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 975/1938] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:09.285889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.285889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.313639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666151-1c8f-4038-98ff-80a67bae5ea7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.317527 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.318191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.318647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.318958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.320968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.328960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:09.375616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8de9-6bf3-4ba6-b0ce-bf34f16b5593 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.381135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.382033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.382315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.382594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] PATH_INFO: `/v3/users/a0b083d8a80c4fc9a1092c1f2b794fa2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.383873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b083d8a80c4fc9a1092c1f2b794fa2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.386122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.397835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.399887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.417087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 964/1939] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:09 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:09.417938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.420099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.443744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8116-5b77-4442-9068-e64116ab5630 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.454916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.455640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.456000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.456544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.457290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.461220 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.465080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b083d8a80c4fc9a1092c1f2b794fa2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.482567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b083d8a80c4fc9a1092c1f2b794fa2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.494987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 965/1940] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:09 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:09.496397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.498579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.499439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b083d8a80c4fc9a1092c1f2b794fa2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.500278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b083d8a80c4fc9a1092c1f2b794fa2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.508882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b083d8a80c4fc9a1092c1f2b794fa2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.516382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 976/1941] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:09 2022] DELETE /identity/v3/users/a0b083d8a80c4fc9a1092c1f2b794fa2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:09.517392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.519089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.604663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3170af1-4c29-446a-b34a-8987c893f996 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.612947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.613814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.614103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.614522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.615448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.618015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.648404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db504af-394b-4abd-8ac6-d9404fc262e7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.651108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 977/1942] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:09 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:09.653547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.654960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.655916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.656209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.656495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] PATH_INFO: `/v3/users/f5548f9ff67d47d48a6fcc22a8d29329` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.658405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5548f9ff67d47d48a6fcc22a8d29329)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.660938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.677847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:09.680120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc9fd-b6e1-40ed-924d-e5da2879190c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.693106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.693808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.694093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.694374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.695124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.696788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.714338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 978/1943] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:09.715469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.727408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067a1f-c437-44a4-97b4-b432f11c498f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.743028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.744090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.744382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.744665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] PATH_INFO: `/v3/projects/7f0bde5e4fac478b858cfb39cf9679b6/users/ec437f2fd97e4ed2b28a67304bd48cbe/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.755572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5548f9ff67d47d48a6fcc22a8d29329'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.768227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0bde5e4fac478b858cfb39cf9679b6, user_id=ec437f2fd97e4ed2b28a67304bd48cbe, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.772552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5548f9ff67d47d48a6fcc22a8d29329'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.773072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:09.788279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:09.789955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5548f9ff67d47d48a6fcc22a8d29329'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.790686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5548f9ff67d47d48a6fcc22a8d29329'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.799163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-841205b0-53a3-4893-b0fa-f74e6a6ade09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5548f9ff67d47d48a6fcc22a8d29329'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:09.802808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 979/1944] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:09 2022] PUT /identity/v3/projects/7f0bde5e4fac478b858cfb39cf9679b6/users/ec437f2fd97e4ed2b28a67304bd48cbe/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:09.804623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.809288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.814597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 966/1945] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:09 2022] DELETE /identity/v3/users/f5548f9ff67d47d48a6fcc22a8d29329 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:09.818796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.819092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.819375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.845641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:09.847018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.936249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 967/1946] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:09.962919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:09.967507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:09.969968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ae4cf-6c1c-4f8c-9512-b3beaad05a5e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:09.975942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:09.977324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:09.978475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:09.978927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:09.980731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:09.983807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.032250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 980/1947] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:10.036267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:10.059559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9911-954d-42c4-b3d8-28d6f6eb57d5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.073429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4490-1f2a-47a8-a833-157bf4913dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.075960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4490-1f2a-47a8-a833-157bf4913dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.077644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4490-1f2a-47a8-a833-157bf4913dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.078149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4490-1f2a-47a8-a833-157bf4913dd0 admin admin] PATH_INFO: `/v3/projects/7f0bde5e4fac478b858cfb39cf9679b6/users/ec437f2fd97e4ed2b28a67304bd48cbe/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.082306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b4490-1f2a-47a8-a833-157bf4913dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0bde5e4fac478b858cfb39cf9679b6, user_id=ec437f2fd97e4ed2b28a67304bd48cbe, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.087559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b4490-1f2a-47a8-a833-157bf4913dd0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.122327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 981/1948] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:10 2022] PUT /identity/v3/projects/7f0bde5e4fac478b858cfb39cf9679b6/users/ec437f2fd97e4ed2b28a67304bd48cbe/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:10.137808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.139006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.139492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.167738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50de9ba-2650-4fd9-9827-07241f969d65 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.203036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] MFA Rules not processed for user `ec437f2fd97e4ed2b28a67304bd48cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:10.205120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.267634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:10.287594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.288964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.289264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.289688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.348136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 982/1949] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:10.361783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:10.363973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.417869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.420472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.448268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 968/1950] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:10.468631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f76e01-8b66-4730-8e04-708ccc4074f5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.474535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.475217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.475882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.476169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.485961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:10.487593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.504522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.510319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.514763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40645-b284-4031-8dba-fb31bdbf00f0 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.529581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.532062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.532354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.532633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] PATH_INFO: `/v3/projects/839e75e4ae34409ab260013680747b1b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.535251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839e75e4ae34409ab260013680747b1b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.537597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.541423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 983/1951] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:10.630223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839e75e4ae34409ab260013680747b1b', 'request_id': 'req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:10.631542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:10.634017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.639306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839e75e4ae34409ab260013680747b1b', 'request_id': 'req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:10.649951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839e75e4ae34409ab260013680747b1b', 'request_id': 'req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:10.657420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a811b-599a-4345-ba15-f77a63324a72 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.675312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] The token cache is being invalidate because project 839e75e4ae34409ab260013680747b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:10.675869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:10.676613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0b98c8f3-ec7a-4e7a-b39e-efd88fa46088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:10.678419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 969/1952] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:10 2022] DELETE /identity/v3/projects/839e75e4ae34409ab260013680747b1b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:10.681842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:10.683270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a61d7b-743e-4494-88b4-9e8ca545ccf3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.683646 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a61d7b-743e-4494-88b4-9e8ca545ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.684110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a61d7b-743e-4494-88b4-9e8ca545ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.706670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-16a61d7b-743e-4494-88b4-9e8ca545ccf3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:10.708140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-16a61d7b-743e-4494-88b4-9e8ca545ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.769122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.770410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.770743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.771320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.774615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.841456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 970/1953] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:10.842986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.843277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.843652 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.866807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:10.868846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:10.882523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 971/1954] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:10.883630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:10.895354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb6bf4-b21f-4b5b-a6e3-7827299c250d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.899588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.901524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.901741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.902667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.903033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.903405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.904211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:10.904527 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.906260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.915978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:10.921825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 984/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:10.933371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 972/1956] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:10.936822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:10.951162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4484e0-c056-4f82-be77-d3311b8ff4b8 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:10.957013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:10.958046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:10.958493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:10.958829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:10.959649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:10.961825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:10.996716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 985/1957] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:10 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:11.002336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.019342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d01a7-a008-4dec-b183-2bf034c4e36f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:11.116961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:11.120202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:11.121695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:11.122113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:11.123043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:11.128754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:11.174753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.187628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 973/1958] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:11 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:11.188868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e5ee-7def-4a27-a67f-8d4bc2b1a8f2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:11.205755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:11.207466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:11.210351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:11.210768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:11.211899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:11.215805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:11.247322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.257753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 986/1959] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:11.259325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4721d-c304-4bae-b90e-706712c48cbd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:11.274493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266c80e-8205-4df5-acaa-36678a08b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:11.275631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c80e-8205-4df5-acaa-36678a08b244 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:11.276121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c80e-8205-4df5-acaa-36678a08b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:11.277338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c80e-8205-4df5-acaa-36678a08b244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:11.278369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266c80e-8205-4df5-acaa-36678a08b244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:11.280630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266c80e-8205-4df5-acaa-36678a08b244 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:11.296958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.310717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc012ef-5259-4003-a27e-63ba27084a76 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:11.311136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 974/1960] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:11.324927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:11.326102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:11.326459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:11.326809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] PATH_INFO: `/v3/projects/41e92da189f94551a3622f4d0efe4fbb/users/c61ca738a66340409b04df96ea5864ce/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:11.354388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e92da189f94551a3622f4d0efe4fbb, user_id=c61ca738a66340409b04df96ea5864ce, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:11.358286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:11.405782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 987/1961] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:11 2022] PUT /identity/v3/projects/41e92da189f94551a3622f4d0efe4fbb/users/c61ca738a66340409b04df96ea5864ce/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:11.410004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:11.410559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:11.411228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:11.466672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] MFA Rules not processed for user `c61ca738a66340409b04df96ea5864ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:11.468013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:11.685997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 975/1962] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:11.699090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.701944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:11.819178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273cdb-fa1f-4322-bddb-0fa511050010 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:11.824615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:11.825300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:11.825625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:11.825909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:11.841131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:11.843294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:11.855079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 988/1963] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:11.878700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.901936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:11.904510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:11.958410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:12.065443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ab6dc-9eb3-4565-8d05-6ea7eb7183ed None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.073223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62e437-996f-4029-808e-886527fe6fd1 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.073885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.075198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.075971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.076535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] PATH_INFO: `/v3/users/c61ca738a66340409b04df96ea5864ce` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.078882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.079707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61ca738a66340409b04df96ea5864ce)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.079863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.080139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.080571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] PATH_INFO: `/v3/projects/5e70624385e448fe9b2af39f65daba50` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.082134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e70624385e448fe9b2af39f65daba50)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.084392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.085249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.097150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:12.163217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61ca738a66340409b04df96ea5864ce'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.168272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e70624385e448fe9b2af39f65daba50', 'request_id': 'req-57871e87-713c-4f06-8d80-842827c0b002'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.175613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61ca738a66340409b04df96ea5864ce'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.180777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e70624385e448fe9b2af39f65daba50', 'request_id': 'req-57871e87-713c-4f06-8d80-842827c0b002'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.192619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e70624385e448fe9b2af39f65daba50', 'request_id': 'req-57871e87-713c-4f06-8d80-842827c0b002'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.196264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61ca738a66340409b04df96ea5864ce'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.197016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61ca738a66340409b04df96ea5864ce'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.205550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-32ee44e3-43de-4241-abd7-f90c8047f416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61ca738a66340409b04df96ea5864ce'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.209645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] The token cache is being invalidate because project 5e70624385e448fe9b2af39f65daba50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:12.209999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.210733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-57871e87-713c-4f06-8d80-842827c0b002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:12.212973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 989/1964] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:11 2022] DELETE /identity/v3/projects/5e70624385e448fe9b2af39f65daba50 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:12.215809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 976/1965] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:11 2022] DELETE /identity/v3/users/c61ca738a66340409b04df96ea5864ce => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:12.219521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.219849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.220265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.223039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945fcb0-ebd7-483c-a398-99d2cd112ece None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.223379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945fcb0-ebd7-483c-a398-99d2cd112ece None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.224089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945fcb0-ebd7-483c-a398-99d2cd112ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.241596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:12.243023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:12.245367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f945fcb0-ebd7-483c-a398-99d2cd112ece None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:12.249617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f945fcb0-ebd7-483c-a398-99d2cd112ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:12.327830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 990/1966] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:12.334888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 977/1967] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:12.337499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.338934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.338934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.346598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.348495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:12.362551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:12.363861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:12.376326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 991/1968] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:12.381087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.393140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44facf3f-69b6-4cd8-b344-2b8c552f1c12 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.397929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.398625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.398918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.399201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.399969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:12.400284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.402075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.422269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 992/1969] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:12.423687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.425384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dfb7e-5272-4738-bbad-2e39fff9c0e8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.429117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.429916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.430209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.430484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.435430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a476ee-71eb-45da-93fc-35af3778a4fd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.442469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.443103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.444185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.444185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.444601 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.444996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.446271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.447185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.461992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 978/1970] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:12.474998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:12.485202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 993/1971] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:12 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:12.489579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.500921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca967c-59e8-4108-8e24-ed753c9c5319 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.552002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:12.605106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.606014 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.606294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.606566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.607959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.610047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.647358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 979/1972] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:12 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:12.648644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.663213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21937a17-c3b3-44f8-a09c-04b304eaf116 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.669490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.670220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.670499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.670759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.671560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.673254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.685352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 994/1973] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:12.689440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.700978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a944af-7deb-47e8-9f6d-bb61c16b3703 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.706172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6a66-28ce-4f92-87ea-cbe11e610ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.706797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a66-28ce-4f92-87ea-cbe11e610ead admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.707079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a66-28ce-4f92-87ea-cbe11e610ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.707354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a66-28ce-4f92-87ea-cbe11e610ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.708332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f6a66-28ce-4f92-87ea-cbe11e610ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.709746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f6a66-28ce-4f92-87ea-cbe11e610ead admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.738687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 980/1974] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:12.742831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.755306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cb97-db99-4143-80d3-993b5421013b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:12.764343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:12.765530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.766999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.767467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] PATH_INFO: `/v3/projects/e609f89a5049435daa616784f72fbeaf/users/defb7a7d6bfb4e44be3680b434fa3a09/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.788166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e609f89a5049435daa616784f72fbeaf, user_id=defb7a7d6bfb4e44be3680b434fa3a09, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:12.792387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:12.831937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:12.832380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:12.832771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:12.834420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 995/1975] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:12 2022] PUT /identity/v3/projects/e609f89a5049435daa616784f72fbeaf/users/defb7a7d6bfb4e44be3680b434fa3a09/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:12.882024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] MFA Rules not processed for user `defb7a7d6bfb4e44be3680b434fa3a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:12.884186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:12.947415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:12.950457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:13.023316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 981/1976] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:13.027486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.048234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67296f87-4649-4235-8180-488e2c624561 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.054006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.054961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.055247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.055543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] PATH_INFO: `/v3/projects/41e92da189f94551a3622f4d0efe4fbb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.057305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e92da189f94551a3622f4d0efe4fbb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.059511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.115401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c716-344d-49e3-b531-f95fdf4cfab4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.121657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.122525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.122910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.123280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.124290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.126910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.149085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e92da189f94551a3622f4d0efe4fbb', 'request_id': 'req-1f83c613-5d55-451e-a416-977b3fb86cf4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:13.159072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e92da189f94551a3622f4d0efe4fbb', 'request_id': 'req-1f83c613-5d55-451e-a416-977b3fb86cf4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:13.167387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 982/1977] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:13.168500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.170540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e92da189f94551a3622f4d0efe4fbb', 'request_id': 'req-1f83c613-5d55-451e-a416-977b3fb86cf4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:13.201151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] The token cache is being invalidate because project 41e92da189f94551a3622f4d0efe4fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:13.201658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:13.202522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1f83c613-5d55-451e-a416-977b3fb86cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:13.204562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:13.206398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 996/1978] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:12 2022] DELETE /identity/v3/projects/41e92da189f94551a3622f4d0efe4fbb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:13.214825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806da19f-d9c7-400f-b59b-6e236ae3f51a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.215371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806da19f-d9c7-400f-b59b-6e236ae3f51a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.215869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806da19f-d9c7-400f-b59b-6e236ae3f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.240821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-806da19f-d9c7-400f-b59b-6e236ae3f51a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:13.242219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-806da19f-d9c7-400f-b59b-6e236ae3f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:13.289210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925777c-10bc-43bf-a4db-41e2f877c7be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.310806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.312416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.313897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.314274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.315664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.323974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.348950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:13.371237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 983/1979] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:13.375309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.377995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:13.381978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 997/1980] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:13.394313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.394713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.395222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.405551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3dcd9-039f-4478-b5cd-16f8c708f030 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.415598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:13.417252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:13.420519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.421415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.421722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.422002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.423810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.424427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.428641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 998/1981] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:13.432822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.444128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e6348-2c37-44a2-9d25-ac9337a99b8a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.449609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 984/1982] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:13.452253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.453057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.453424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.453814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.454812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:13.455326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.455456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.457508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.477016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fd4a-650c-4e13-b14e-65136ac6a719 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.484000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 999/1983] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:37:13.486883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.489497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.490227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.490521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.490806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.491559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.499026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.521952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 985/1984] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:13.523242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.529487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1cac2-a5cb-4dac-b8f6-7e1ca1246f11 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.547296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.548065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.548362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.548648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.549389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.551516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.557100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98e309-89de-4c5f-887b-16447754677e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.564572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889ae16-6913-4737-a539-ce9e731401ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.565592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889ae16-6913-4737-a539-ce9e731401ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.565886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889ae16-6913-4737-a539-ce9e731401ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.566165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889ae16-6913-4737-a539-ce9e731401ad admin admin] PATH_INFO: `/v3/projects/7e1407e91ba8463c94a581ddd2a4d098/users/ee6ea16ea58445d0b4f0196ea9d7ec58/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.595237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889ae16-6913-4737-a539-ce9e731401ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1407e91ba8463c94a581ddd2a4d098, user_id=ee6ea16ea58445d0b4f0196ea9d7ec58, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.600374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889ae16-6913-4737-a539-ce9e731401ad admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.619982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1000/1985] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:13.624102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.642356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 986/1986] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:13 2022] PUT /identity/v3/projects/7e1407e91ba8463c94a581ddd2a4d098/users/ee6ea16ea58445d0b4f0196ea9d7ec58/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:13.652827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.653393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.654020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.689786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] MFA Rules not processed for user `ee6ea16ea58445d0b4f0196ea9d7ec58`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:13.692594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:13.765388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8a55-43c7-435d-9248-d1d24c1098c1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.771157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.772013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.772403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.772986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.774614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.779917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.808750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1001/1987] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:13.822630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.839403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 987/1988] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:13.845362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf381608-048b-43e2-9d79-da0bb513a9b5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.845884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.851360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.852396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.852812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.853184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.854484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.856089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.870537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c9c0e-6817-462a-8f3c-9091ef08063b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.878245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.879760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.880443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.880443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.881337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.885255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1002/1989] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:13.889432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.889761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.926660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db1d8-8fa0-4422-adc2-1739d4c2f2da admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:13.936049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 988/1990] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:13.937065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:13.937823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:13.939153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.940408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:13.940688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:13.941438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:13.943135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:13.959023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1003/1991] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:13.963109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:13.992169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1af2d-df64-41e3-b091-004ea76a7863 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.002134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:14.063264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540b9c4-1fed-44de-87ca-8dfa94c23115 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.068247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.068938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.069263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.069555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.070305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.072368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.085833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60794520-1701-4b6f-b055-7b5b6b2634a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.086864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60794520-1701-4b6f-b055-7b5b6b2634a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.087183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60794520-1701-4b6f-b055-7b5b6b2634a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.087496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60794520-1701-4b6f-b055-7b5b6b2634a6 admin admin] PATH_INFO: `/v3/projects/59ca9220df5842b6878f1a40e800f0b0/users/6bc1e479d32d4afd986d2cc7855f8120/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.098300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 989/1992] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:13 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:14.102402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.113820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60794520-1701-4b6f-b055-7b5b6b2634a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ca9220df5842b6878f1a40e800f0b0, user_id=6bc1e479d32d4afd986d2cc7855f8120, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.116107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318496ac-bf47-4332-9c62-dc26cbf13cc4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.118248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60794520-1701-4b6f-b055-7b5b6b2634a6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.123313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.125990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.126536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.126884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.127710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.129695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.139682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1004/1993] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:13 2022] PUT /identity/v3/projects/59ca9220df5842b6878f1a40e800f0b0/users/6bc1e479d32d4afd986d2cc7855f8120/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:14.149689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 990/1994] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:14.149689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.152378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.152921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.153388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.161448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab80f-c38e-4b78-a098-a96a174fdd2f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.162084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:14.188293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] MFA Rules not processed for user `6bc1e479d32d4afd986d2cc7855f8120`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:14.189515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:14.254825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.257367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.258296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.259284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] PATH_INFO: `/v3/projects/dc18b81bdd38410db310bc939ed8b295/users/0ea70d6e3d114d4e9852b4cca4ce0452/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.287414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc18b81bdd38410db310bc939ed8b295, user_id=0ea70d6e3d114d4e9852b4cca4ce0452, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.292998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.329253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 991/1995] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:14 2022] PUT /identity/v3/projects/dc18b81bdd38410db310bc939ed8b295/users/0ea70d6e3d114d4e9852b4cca4ce0452/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:14.330336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.358610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1005/1996] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:14.366476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.369820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:14.458818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1082da-cbab-4c7f-9872-aa0a51fc45fa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.514031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580efc-d9e4-49d7-8fd2-35ef37522420 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.520336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cebfd-5115-4f02-9d5f-125878c4d34c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.521091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cebfd-5115-4f02-9d5f-125878c4d34c service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.521345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cebfd-5115-4f02-9d5f-125878c4d34c service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.521633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cebfd-5115-4f02-9d5f-125878c4d34c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.525613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.526387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.527414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.528134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.530060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.535247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.560833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 992/1997] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:14.566578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.593253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cebfd-5115-4f02-9d5f-125878c4d34c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.594629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02cddc-5d59-4f64-b886-89b74b0e2259 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.594983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cebfd-5115-4f02-9d5f-125878c4d34c service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.609813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1006/1998] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:14.610843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.611798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.612084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.612361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] PATH_INFO: `/v3/projects/dc18b81bdd38410db310bc939ed8b295/users/0ea70d6e3d114d4e9852b4cca4ce0452/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.615133 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc18b81bdd38410db310bc939ed8b295, user_id=0ea70d6e3d114d4e9852b4cca4ce0452, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.617956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.642213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 993/1999] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:14 2022] PUT /identity/v3/projects/dc18b81bdd38410db310bc939ed8b295/users/0ea70d6e3d114d4e9852b4cca4ce0452/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:14.664889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.665179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.665457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.680641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:14.710635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] MFA Rules not processed for user `0ea70d6e3d114d4e9852b4cca4ce0452`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:14.712114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:14.785648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.788685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:14.821345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:14.846094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1007/2000] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:14.865335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:14.868431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:14.930328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8071-2a8b-46cd-abda-256d84028f44 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.936406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.937422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.937758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.937983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] PATH_INFO: `/v3/users/d03df4f45ac7439b8a478930d7f59d9b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.944540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03df4f45ac7439b8a478930d7f59d9b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:14.946726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:14.957774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d7ae-35aa-462e-874b-23ef0cf88e18 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:14.967184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:14.967936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:14.968221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:14.968503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:14.970818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:15.047016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03df4f45ac7439b8a478930d7f59d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:15.063076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03df4f45ac7439b8a478930d7f59d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:15.065990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:15.067679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e334c6-d460-4d2d-8898-1e742518c7a8 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:15.079665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1008/2001] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:15.087798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03df4f45ac7439b8a478930d7f59d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:15.088945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03df4f45ac7439b8a478930d7f59d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:15.099298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03df4f45ac7439b8a478930d7f59d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:15.107641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 994/2002] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:14 2022] DELETE /identity/v3/users/d03df4f45ac7439b8a478930d7f59d9b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:15.112438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:15.112737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:15.113008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:15.159374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:15.160666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:15.289698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:15.326962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1009/2003] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:15.339663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:15.342304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:15.422568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a961-dffe-4c28-8c51-45b0a886aee6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:15.426610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:15.427363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:15.427741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:15.428109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:15.441340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:15.443274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:15.460449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 995/2004] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:16.045943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:16.047482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:16.061930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c6ad-de1e-4764-addc-0665a2fb8ba6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:16.071088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:16.072185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:16.072610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:16.073292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] PATH_INFO: `/v3/projects/73db487a8d284d6ba4eff8fc504253f5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:16.074436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73db487a8d284d6ba4eff8fc504253f5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:16.076799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:16.134754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73db487a8d284d6ba4eff8fc504253f5', 'request_id': 'req-97afc23f-69e8-4470-b427-a6187594f9c5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.145229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73db487a8d284d6ba4eff8fc504253f5', 'request_id': 'req-97afc23f-69e8-4470-b427-a6187594f9c5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.153280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73db487a8d284d6ba4eff8fc504253f5', 'request_id': 'req-97afc23f-69e8-4470-b427-a6187594f9c5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.167254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] The token cache is being invalidate because project 73db487a8d284d6ba4eff8fc504253f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:16.167534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.168306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.170582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1010/2005] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:16 2022] DELETE /identity/v3/projects/73db487a8d284d6ba4eff8fc504253f5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:16.174493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:16.186063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ef22d-5af1-41bb-9d39-a012a74395a4 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:16.252778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:16.281892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:16.282801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:16.283937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:16.284394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] PATH_INFO: `/v3/users/d58343598cf54cf7bb30087afb093a2c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:16.286002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58343598cf54cf7bb30087afb093a2c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:16.288492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:16.369958 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58343598cf54cf7bb30087afb093a2c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.388574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58343598cf54cf7bb30087afb093a2c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.404990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58343598cf54cf7bb30087afb093a2c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.407184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58343598cf54cf7bb30087afb093a2c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.419814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58343598cf54cf7bb30087afb093a2c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:16.427760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 996/2006] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:16 2022] DELETE /identity/v3/users/d58343598cf54cf7bb30087afb093a2c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:16.921105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:16.922735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:16.952996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afc23f-69e8-4470-b427-a6187594f9c5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:17.004603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:17.006246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.052703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:17.053814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.054109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.054528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] PATH_INFO: `/v3/projects/10af70b2f5a84e7a850c3596122ccc6d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.055982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10af70b2f5a84e7a850c3596122ccc6d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:17.058022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:17.078934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965545e2-7ac6-4838-8bca-02ff4a11514d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:17.082909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:17.083441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.083745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.084021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.086115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.130128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10af70b2f5a84e7a850c3596122ccc6d', 'request_id': 'req-73780fc6-2b43-4079-9124-231b91252194'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.143497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10af70b2f5a84e7a850c3596122ccc6d', 'request_id': 'req-73780fc6-2b43-4079-9124-231b91252194'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.152793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10af70b2f5a84e7a850c3596122ccc6d', 'request_id': 'req-73780fc6-2b43-4079-9124-231b91252194'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.165290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:17.171758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] The token cache is being invalidate because project 10af70b2f5a84e7a850c3596122ccc6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:17.172064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.173276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.175098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1011/2007] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:16 2022] DELETE /identity/v3/projects/10af70b2f5a84e7a850c3596122ccc6d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:17.179696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:17.181263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.195595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:17.197403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:17.209356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 997/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:17.254432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73780fc6-2b43-4079-9124-231b91252194 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:17.259203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:17.260211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.260490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.261019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] PATH_INFO: `/v3/users/ec437f2fd97e4ed2b28a67304bd48cbe` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.262323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec437f2fd97e4ed2b28a67304bd48cbe)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:17.265065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:17.317084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec437f2fd97e4ed2b28a67304bd48cbe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.324551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec437f2fd97e4ed2b28a67304bd48cbe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.338767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec437f2fd97e4ed2b28a67304bd48cbe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.339471 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec437f2fd97e4ed2b28a67304bd48cbe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.347067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec437f2fd97e4ed2b28a67304bd48cbe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.353546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1012/2009] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:17 2022] DELETE /identity/v3/users/ec437f2fd97e4ed2b28a67304bd48cbe => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:17.653986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:17.655983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.656123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:17.657396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.675702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0b39-388c-43fd-a626-d444263a7ca7 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:17.700025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:17.761833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:17.763273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.763565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.763900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] PATH_INFO: `/v3/users/6bc1e479d32d4afd986d2cc7855f8120` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.765212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc1e479d32d4afd986d2cc7855f8120)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:17.767355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:17.767701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac45ad-e67d-4613-ac38-c1b7164ff1d3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:17.773144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:17.775891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.775891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.775891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] PATH_INFO: `/v3/projects/7f0bde5e4fac478b858cfb39cf9679b6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.776307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0bde5e4fac478b858cfb39cf9679b6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:17.780021 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:17.828392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:17.834063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc1e479d32d4afd986d2cc7855f8120'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.845471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc1e479d32d4afd986d2cc7855f8120'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.861213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc1e479d32d4afd986d2cc7855f8120'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.861520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0bde5e4fac478b858cfb39cf9679b6', 'request_id': 'req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.862048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc1e479d32d4afd986d2cc7855f8120'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.871137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0bde5e4fac478b858cfb39cf9679b6', 'request_id': 'req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.873702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc1e479d32d4afd986d2cc7855f8120'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.878197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0bde5e4fac478b858cfb39cf9679b6', 'request_id': 'req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.886946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 998/2010] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:17 2022] DELETE /identity/v3/users/6bc1e479d32d4afd986d2cc7855f8120 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:17.886946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:17.889586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.892592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] The token cache is being invalidate because project 7f0bde5e4fac478b858cfb39cf9679b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:17.892886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.893662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1de344b9-38e3-45b0-8a7c-4b3ccab4dae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:17.895147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1013/2011] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:17 2022] DELETE /identity/v3/projects/7f0bde5e4fac478b858cfb39cf9679b6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:17.901418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47551ba-34b9-4f3d-80a4-68ad20debc46 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.902261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47551ba-34b9-4f3d-80a4-68ad20debc46 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.903257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47551ba-34b9-4f3d-80a4-68ad20debc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.925497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b47551ba-34b9-4f3d-80a4-68ad20debc46 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:17.926828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b47551ba-34b9-4f3d-80a4-68ad20debc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.964068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147d1c9-b518-4389-9bac-ecd7c8213670 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:17.968441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:17.969126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.969414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.969692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:17.971522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:17.990558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1014/2012] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:17.991815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:17.992112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:17.992400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.011348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:18.012604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.021741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1015/2013] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:18.022545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.023838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.029768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:18.047061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.048606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffd4c1-774b-4be0-aaaa-7fdfa4471b95 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.060397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 999/2014] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:18.061714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.062113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.062404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.087530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0b9ca-93dc-4ef4-bccf-08f63e1ebede None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.091343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.092069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.092353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.092628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.092731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:18.093978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.105912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1000/2015] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:18.107125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.108285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.109964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.121105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1016/2016] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:18.125346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c43514-455d-47ac-b6dc-d305cc61f21b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.132894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.133595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.133912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.134206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.136213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:18.136543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.138876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.152946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1001/2017] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:37:18.159236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.172106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc36f0-6171-4eca-a695-4b3542558f4f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.180387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.180387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.180387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.180387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.180780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.181764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.231336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1017/2018] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:18.236720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.248953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027c8a8-0c6b-4a7e-9ca5-10b1bf9439ee admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.339654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.340975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.341267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.341587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.342376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.344388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.380936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1002/2019] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:18.385152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.397965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2618b7-2b04-4952-8004-5a59bf03014e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.403011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.403822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.404115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.404395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.405174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.406910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.418854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1018/2020] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:18.423436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.433951 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e8205-50ef-4b72-9b4d-8ff9c4c8791e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.440219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.440947 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.441237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.441517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.442314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.444009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.455598 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1003/2021] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:18.460003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.470040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f509e3c-8da3-4d50-9233-61393aa0729b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.475208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54c7a-0d84-44c4-92ee-a5cf23635d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.476206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54c7a-0d84-44c4-92ee-a5cf23635d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.476474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54c7a-0d84-44c4-92ee-a5cf23635d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.476752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54c7a-0d84-44c4-92ee-a5cf23635d02 admin admin] PATH_INFO: `/v3/projects/b52419bce204499899da61fee483a3a3/users/07f3f6934b3b4e759a25562064a5e4f7/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.486350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:18.495846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc54c7a-0d84-44c4-92ee-a5cf23635d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52419bce204499899da61fee483a3a3, user_id=07f3f6934b3b4e759a25562064a5e4f7, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.499273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc54c7a-0d84-44c4-92ee-a5cf23635d02 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.501110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.503946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.517326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1019/2022] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:18 2022] PUT /identity/v3/projects/b52419bce204499899da61fee483a3a3/users/07f3f6934b3b4e759a25562064a5e4f7/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:18.520506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501a95-8486-48b5-a7ee-495e1dd74bff admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.522831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.523190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.523601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.544623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:18.545893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.583848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.584765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.585051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.585330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] PATH_INFO: `/v3/projects/59ca9220df5842b6878f1a40e800f0b0` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.586569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ca9220df5842b6878f1a40e800f0b0)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.588545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.609870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1020/2023] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:18.634340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:18.638989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ca9220df5842b6878f1a40e800f0b0', 'request_id': 'req-a3363f2c-6b00-4854-9970-d3f8baefd6d1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:18.647821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ca9220df5842b6878f1a40e800f0b0', 'request_id': 'req-a3363f2c-6b00-4854-9970-d3f8baefd6d1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:18.651051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.654185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ca9220df5842b6878f1a40e800f0b0', 'request_id': 'req-a3363f2c-6b00-4854-9970-d3f8baefd6d1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:18.667973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] The token cache is being invalidate because project 59ca9220df5842b6878f1a40e800f0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:18.668274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:18.669125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3363f2c-6b00-4854-9970-d3f8baefd6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:18.671438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1004/2024] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:18 2022] DELETE /identity/v3/projects/59ca9220df5842b6878f1a40e800f0b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:18.676182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678dde-18cf-4fc2-99db-2431ffdd6f7f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.676737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678dde-18cf-4fc2-99db-2431ffdd6f7f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.677254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678dde-18cf-4fc2-99db-2431ffdd6f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.697849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4e678dde-18cf-4fc2-99db-2431ffdd6f7f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:18.699171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4e678dde-18cf-4fc2-99db-2431ffdd6f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.713926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf586a8-e52d-404b-836b-06fb253573ce None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.770984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1005/2025] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:18.772965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.773839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.774154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.774439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.776508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.779616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.779928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.780260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.793148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.794697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.803187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:18.804585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:18.805912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1021/2026] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:18.813937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1006/2027] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:18.818392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.829343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d173c7-5c69-40e8-b375-d7f22f56d3f1 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.834320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.835043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.835311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.835592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.836366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:18.836677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.838631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.855594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1022/2028] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:18.857088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.867121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52934269-7828-4ea9-8b84-666523b18cd8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.875183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.876238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.876356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.876668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.877583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.879902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:18.915431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1007/2029] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:18.916638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:18.927510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06d42-3636-4b87-b5ad-045421d742cf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:18.962096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:18.992153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:18.992849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:18.993135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:18.993415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:18.994117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:18.996162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:19.021740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1023/2030] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:18 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:19.032835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:19.047811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53704-e5e7-418b-81ab-def5cadd3e41 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:19.053036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:19.053757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:19.054039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:19.054369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:19.055675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:19.058459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:19.078048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1008/2031] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:19.079812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:19.096599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4c655-c1c2-49f7-bd5a-d0ff981fa0ad admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:19.103947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61523343-8ba7-4db9-953a-7bcb0186ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:19.104846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61523343-8ba7-4db9-953a-7bcb0186ad07 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:19.104995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61523343-8ba7-4db9-953a-7bcb0186ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:19.105209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61523343-8ba7-4db9-953a-7bcb0186ad07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:19.105979 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61523343-8ba7-4db9-953a-7bcb0186ad07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:19.108228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61523343-8ba7-4db9-953a-7bcb0186ad07 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:19.120806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1024/2032] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:19.126676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:19.142713 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb29e-9d42-451c-b8d4-f57959e1164e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:19.150633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:19.151683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:19.151978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:19.152255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] PATH_INFO: `/v3/projects/5125c4badf3d4c6f979dfeeac3a43a38/users/3fd6c3acc4ab4fd3801eb731b43fbd9c/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:19.177959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5125c4badf3d4c6f979dfeeac3a43a38, user_id=3fd6c3acc4ab4fd3801eb731b43fbd9c, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:19.185052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:19.199427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1009/2033] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:19 2022] PUT /identity/v3/projects/5125c4badf3d4c6f979dfeeac3a43a38/users/3fd6c3acc4ab4fd3801eb731b43fbd9c/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:19.205003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178148-84ff-4494-9d11-9aa2bfc0b534 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:19.205298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178148-84ff-4494-9d11-9aa2bfc0b534 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:19.205753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178148-84ff-4494-9d11-9aa2bfc0b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:19.228026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2b178148-84ff-4494-9d11-9aa2bfc0b534 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:19.229254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2b178148-84ff-4494-9d11-9aa2bfc0b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:19.305451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1025/2034] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:19.316159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:19.319197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:19.401335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d994-0cb7-4506-889a-ab3716df5026 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:19.408552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:19.409463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:19.409903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:19.410386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:19.426515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:19.436280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:19.468563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1010/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:20.474240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:20.474764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:20.474856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:20.502480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] MFA Rules not processed for user `3fd6c3acc4ab4fd3801eb731b43fbd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:20.503747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:20.620479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1026/2036] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:20.623248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:20.625556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:20.655961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:20.815162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4074-a197-4983-b3de-6ea4be0422b4 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:20.840717 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05065a1-de1e-4eec-aa2e-0f7e2808107e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:20.841896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05065a1-de1e-4eec-aa2e-0f7e2808107e service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:20.842365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05065a1-de1e-4eec-aa2e-0f7e2808107e service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:20.842796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05065a1-de1e-4eec-aa2e-0f7e2808107e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:20.868353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05065a1-de1e-4eec-aa2e-0f7e2808107e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:20.874769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05065a1-de1e-4eec-aa2e-0f7e2808107e service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:20.905063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1011/2037] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:22.291132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:22.293242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:22.309585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15197ec0-1c1c-44a6-9716-228fe3527600 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:22.315402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:22.316761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:22.317222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:22.317661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] PATH_INFO: `/v3/users/defb7a7d6bfb4e44be3680b434fa3a09` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:22.320517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=defb7a7d6bfb4e44be3680b434fa3a09)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:22.326163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:22.381005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:22.401013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defb7a7d6bfb4e44be3680b434fa3a09'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:22.412650 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defb7a7d6bfb4e44be3680b434fa3a09'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:22.447089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defb7a7d6bfb4e44be3680b434fa3a09'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:22.447946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defb7a7d6bfb4e44be3680b434fa3a09'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:22.461825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d850d5ad-f8b6-447b-ace9-0b3590b5f77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defb7a7d6bfb4e44be3680b434fa3a09'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:22.485316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1027/2038] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:22 2022] DELETE /identity/v3/users/defb7a7d6bfb4e44be3680b434fa3a09 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:22.485541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:22.485541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:22.486081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:22.487348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:22.487688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:22.488067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:22.511029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] MFA Rules not processed for user `3fd6c3acc4ab4fd3801eb731b43fbd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:22.513631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:22.518039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:22.519405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:22.603186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1028/2039] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:22.639523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1012/2040] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:22.650712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:22.652687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:22.760966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7f3e-0b8e-4b61-bac6-1022f63b9039 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:22.767359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:22.768263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:22.768741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:22.769182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:22.784793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:22.787592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:22.807407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1029/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:23.268931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:23.270411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:23.299212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c4333-3499-4c95-ab19-ddc1ef71c368 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:23.305184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:23.306091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:23.306382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:23.306656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] PATH_INFO: `/v3/projects/e609f89a5049435daa616784f72fbeaf` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:23.313452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e609f89a5049435daa616784f72fbeaf)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:23.317657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:23.442023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e609f89a5049435daa616784f72fbeaf', 'request_id': 'req-b745d232-1f7f-44b5-873a-296d1e4667bf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.458762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e609f89a5049435daa616784f72fbeaf', 'request_id': 'req-b745d232-1f7f-44b5-873a-296d1e4667bf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.470973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e609f89a5049435daa616784f72fbeaf', 'request_id': 'req-b745d232-1f7f-44b5-873a-296d1e4667bf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.489091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] The token cache is being invalidate because project e609f89a5049435daa616784f72fbeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:23.489736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.491363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.496938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1013/2042] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:23 2022] DELETE /identity/v3/projects/e609f89a5049435daa616784f72fbeaf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:23.498178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:23.519791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef84bd-94df-4b4d-aae6-b3825349a9b4 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:23.617872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:23.619055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:23.619924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:23.620395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] PATH_INFO: `/v3/users/ee6ea16ea58445d0b4f0196ea9d7ec58` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:23.622284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6ea16ea58445d0b4f0196ea9d7ec58)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:23.625087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:23.629359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:23.688718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6ea16ea58445d0b4f0196ea9d7ec58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.699138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6ea16ea58445d0b4f0196ea9d7ec58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.717185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6ea16ea58445d0b4f0196ea9d7ec58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.718140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6ea16ea58445d0b4f0196ea9d7ec58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.728138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6ea16ea58445d0b4f0196ea9d7ec58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:23.736366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1030/2043] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:23 2022] DELETE /identity/v3/users/ee6ea16ea58445d0b4f0196ea9d7ec58 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:24.136272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:24.137834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:24.174732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745d232-1f7f-44b5-873a-296d1e4667bf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:24.288170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:24.353129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:24.354042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:24.354399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:24.354821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] PATH_INFO: `/v3/projects/7e1407e91ba8463c94a581ddd2a4d098` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:24.357667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1407e91ba8463c94a581ddd2a4d098)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:24.360163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:24.433070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1407e91ba8463c94a581ddd2a4d098', 'request_id': 'req-1163bc73-e7fc-4289-9fa9-81a1b24893c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.447763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1407e91ba8463c94a581ddd2a4d098', 'request_id': 'req-1163bc73-e7fc-4289-9fa9-81a1b24893c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.453960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1407e91ba8463c94a581ddd2a4d098', 'request_id': 'req-1163bc73-e7fc-4289-9fa9-81a1b24893c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.468373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] The token cache is being invalidate because project 7e1407e91ba8463c94a581ddd2a4d098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:24.469106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.469932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.474848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1014/2044] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:24 2022] DELETE /identity/v3/projects/7e1407e91ba8463c94a581ddd2a4d098 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:24.476575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:24.478654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:24.499506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e87a-b999-4b8e-b0ba-804a8022ac87 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:24.579500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:24.580829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:24.581118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:24.581400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] PATH_INFO: `/v3/users/0ea70d6e3d114d4e9852b4cca4ce0452` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:24.583027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea70d6e3d114d4e9852b4cca4ce0452)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:24.585449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:24.649856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea70d6e3d114d4e9852b4cca4ce0452'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.659406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea70d6e3d114d4e9852b4cca4ce0452'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.680363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea70d6e3d114d4e9852b4cca4ce0452'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.680997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea70d6e3d114d4e9852b4cca4ce0452'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.689453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ef83b4ba-ddaa-427c-bc79-8b513ce98fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea70d6e3d114d4e9852b4cca4ce0452'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:24.692334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:24.706265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1031/2045] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:24 2022] DELETE /identity/v3/users/0ea70d6e3d114d4e9852b4cca4ce0452 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:25.193618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:25.197187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:25.222137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163bc73-e7fc-4289-9fa9-81a1b24893c5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:25.336764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:25.338753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.339269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.339649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] PATH_INFO: `/v3/projects/dc18b81bdd38410db310bc939ed8b295` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.341724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc18b81bdd38410db310bc939ed8b295)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:25.344778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:25.417797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc18b81bdd38410db310bc939ed8b295', 'request_id': 'req-feec73da-58f5-414e-8b55-e59e3cf85a40'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:25.429761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc18b81bdd38410db310bc939ed8b295', 'request_id': 'req-feec73da-58f5-414e-8b55-e59e3cf85a40'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:25.437200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc18b81bdd38410db310bc939ed8b295', 'request_id': 'req-feec73da-58f5-414e-8b55-e59e3cf85a40'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:25.446644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:25.453394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] The token cache is being invalidate because project dc18b81bdd38410db310bc939ed8b295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:25.454031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:25.455267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-feec73da-58f5-414e-8b55-e59e3cf85a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:25.457447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1015/2046] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:25 2022] DELETE /identity/v3/projects/dc18b81bdd38410db310bc939ed8b295 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:25.463031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.463329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.463612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.483848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:25.485482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:25.563845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1032/2047] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:25.570015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.570723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.571207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.595874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:25.597490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:25.607432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1016/2048] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:25.612917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:25.625462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aea2e-e62e-41c2-833f-2677fbbbaa0c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:25.631023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:25.631991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.632285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.632553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.633490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:25.633866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:25.635519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:25.653059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1033/2049] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:25.659606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:25.671457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681291-f4db-4f4b-9cb5-face053024a7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:25.676667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:25.677357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.677648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.677924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.678655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:25.681040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:25.737528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1017/2050] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:25 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:25.742396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:25.757186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d315103-3957-4362-975a-b45c817eae39 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:25.912784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:25.914235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.914578 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.914948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.915643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:25.919261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:25.961634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1034/2051] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:25 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:25.966326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:25.977552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72c03f-fda5-44d4-a8bc-c7d9101409c2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:25.983614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:25.984564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:25.984851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:25.985129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:25.985873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:25.987612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:26.013586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1018/2052] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:26.014018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:26.030174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7bb6-7d2a-422c-9ed9-ad6078971130 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:26.045152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0727034-9993-4d9a-920c-194972c4a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:26.046038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0727034-9993-4d9a-920c-194972c4a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:26.046257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0727034-9993-4d9a-920c-194972c4a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:26.046542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0727034-9993-4d9a-920c-194972c4a0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:26.048463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0727034-9993-4d9a-920c-194972c4a0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:26.052496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0727034-9993-4d9a-920c-194972c4a0f1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:26.076536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1035/2053] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:26.082213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:26.095020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ca218-43ce-468c-973d-36f3a7dff579 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:26.112517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:26.113589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:26.113975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:26.114258 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] PATH_INFO: `/v3/projects/e2df15d657e9430286334148a9d1b837/users/735191bfd1a3479cbd4d395355e72e18/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:26.145494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2df15d657e9430286334148a9d1b837, user_id=735191bfd1a3479cbd4d395355e72e18, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:26.148665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:26.171782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1019/2054] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:26 2022] PUT /identity/v3/projects/e2df15d657e9430286334148a9d1b837/users/735191bfd1a3479cbd4d395355e72e18/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:26.183083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee6e6-2918-462c-9ae4-5506d7c61c6e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:26.183898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee6e6-2918-462c-9ae4-5506d7c61c6e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:26.183898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ee6e6-2918-462c-9ae4-5506d7c61c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:26.236639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b55ee6e6-2918-462c-9ae4-5506d7c61c6e None None] MFA Rules not processed for user `735191bfd1a3479cbd4d395355e72e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:26.237473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b55ee6e6-2918-462c-9ae4-5506d7c61c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:26.321809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:26.334830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1036/2055] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:26.347327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:26.349787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:26.489806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb79d4-ede3-4313-b643-0d197f0d3873 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:26.494738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:26.495885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:26.496768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:26.497237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:26.508288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:26.510007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:26.521567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1020/2056] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:26.661860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:26.662984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:26.663475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:26.743948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] MFA Rules not processed for user `07f3f6934b3b4e759a25562064a5e4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:26.746705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:26.904515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1037/2057] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:26.909356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:26.911614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:27.039229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa6f9-4e31-4177-817f-34feadfc3a3a service glance] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:27.046591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:27.047629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:27.048176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:27.048866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:27.049748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:27.052437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:27.091708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1021/2058] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:27.097056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:27.112596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e6d3f-6a77-4bc9-aef4-df698a2440d9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:27.232110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:27.234618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:27.235003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:27.235406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:27.236366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:27.238462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:27.275079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1038/2059] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:27 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:27.277100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:27.283817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:27.312875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5a1a-0f39-49aa-b99e-6ba5eff36e98 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:27.345103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:27.345811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:27.346098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:27.346425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:27.347118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:27.348895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:27.379204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1022/2060] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:27.386536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:27.400322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceeafa-f80c-47f5-84be-85ed0becc495 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:27.407679 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:27.409262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:27.409982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:27.410594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] PATH_INFO: `/v3/projects/56ef63905021419bad84544eed157f0f/users/3f32dbffd0de4970bc8d77048a9b472f/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:27.429622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ef63905021419bad84544eed157f0f, user_id=3f32dbffd0de4970bc8d77048a9b472f, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:27.434057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:27.462034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:27.462944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1039/2061] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:27 2022] PUT /identity/v3/projects/56ef63905021419bad84544eed157f0f/users/3f32dbffd0de4970bc8d77048a9b472f/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:27.474976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f578330-81ea-404c-8d0d-04ea5ec053c6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:27.582287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171a7fb-fa07-4f68-8113-7ba1c7299b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:27.583068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a7fb-fa07-4f68-8113-7ba1c7299b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:27.583633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a7fb-fa07-4f68-8113-7ba1c7299b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:27.584033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a7fb-fa07-4f68-8113-7ba1c7299b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:27.584937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171a7fb-fa07-4f68-8113-7ba1c7299b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:27.586696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171a7fb-fa07-4f68-8113-7ba1c7299b1a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:27.614578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1023/2062] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:27.619742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:27.644272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd9979-3890-4dc3-a6ed-89977d50fe34 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:27.649850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12139bb-f077-4720-99f5-ca7acb783b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:27.650807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12139bb-f077-4720-99f5-ca7acb783b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:27.651246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12139bb-f077-4720-99f5-ca7acb783b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:27.652150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12139bb-f077-4720-99f5-ca7acb783b17 admin admin] PATH_INFO: `/v3/projects/56ef63905021419bad84544eed157f0f/users/3f32dbffd0de4970bc8d77048a9b472f/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:27.655020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12139bb-f077-4720-99f5-ca7acb783b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ef63905021419bad84544eed157f0f, user_id=3f32dbffd0de4970bc8d77048a9b472f, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:27.657906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12139bb-f077-4720-99f5-ca7acb783b17 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:27.676845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1040/2063] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:27 2022] PUT /identity/v3/projects/56ef63905021419bad84544eed157f0f/users/3f32dbffd0de4970bc8d77048a9b472f/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:31.530702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79654d-ba57-4e81-974d-e6d91e6f29a2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:31.531784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79654d-ba57-4e81-974d-e6d91e6f29a2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:31.532347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79654d-ba57-4e81-974d-e6d91e6f29a2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:31.534036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1024/2064] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:37:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:37:31.540076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:31.540649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:31.540649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:31.580775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:31.582335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:31.665919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79654d-ba57-4e81-974d-e6d91e6f29a2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:31.669118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1b79654d-ba57-4e81-974d-e6d91e6f29a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:31.688167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:31.739660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1041/2065] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:31.753362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:31.754647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:31.771606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2b7e-7d1a-4290-9f02-6630f9105971 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:31.780598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:31.781783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:31.782288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:31.783342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:31.790948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79654d-ba57-4e81-974d-e6d91e6f29a2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:31.800826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:31.801917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:31.802307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:31.802789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:31.803263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] PATH_INFO: `/v3/users/cddf62fa4ca944cabb9d3b91f38fde62` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:31.803735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:31.804988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddf62fa4ca944cabb9d3b91f38fde62)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:31.807110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:31.823999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1042/2066] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:31.897769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddf62fa4ca944cabb9d3b91f38fde62'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:31.906934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddf62fa4ca944cabb9d3b91f38fde62'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:31.920939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddf62fa4ca944cabb9d3b91f38fde62'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:31.921698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddf62fa4ca944cabb9d3b91f38fde62'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:31.929363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-915dcbf4-9eef-4f77-9f2c-dbc8fa8b2e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddf62fa4ca944cabb9d3b91f38fde62'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:31.936255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1025/2067] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:31 2022] DELETE /identity/v3/users/cddf62fa4ca944cabb9d3b91f38fde62 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:32.154689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.170090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2261560-210b-4b75-a2aa-0fc23883d95a service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.263758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.264680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.264926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.265140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] PATH_INFO: `/v3/projects/641b840d07634361a1780099fddf24de` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.266701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641b840d07634361a1780099fddf24de)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.269012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:32.334493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641b840d07634361a1780099fddf24de', 'request_id': 'req-027055c8-4a15-4765-8146-0f15f3cbacc7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:32.344667 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641b840d07634361a1780099fddf24de', 'request_id': 'req-027055c8-4a15-4765-8146-0f15f3cbacc7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:32.352148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641b840d07634361a1780099fddf24de', 'request_id': 'req-027055c8-4a15-4765-8146-0f15f3cbacc7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:32.374934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] The token cache is being invalidate because project 641b840d07634361a1780099fddf24de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:32.375247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:32.380200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-027055c8-4a15-4765-8146-0f15f3cbacc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:32.382210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1043/2068] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:32 2022] DELETE /identity/v3/projects/641b840d07634361a1780099fddf24de => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:32.387186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.387490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.387789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.401748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:32.410651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:32.414582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:32.492654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1026/2069] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:32.501380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.501703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.501965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.521480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:32.522737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:32.535771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1044/2070] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:32.540392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.552060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce439ab-2cd7-4a46-97e8-e1518779acce None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.557667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.558499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.558859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.559254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.560255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:32.560633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.562515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:32.579105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1027/2071] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:32.580295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.592292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc59c3-a3dd-4211-a959-5341838c8fc1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.598922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.600008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.600299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.600584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.601296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.603225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:32.640749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1045/2072] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:32 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:32.645409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.656514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5daeac-265c-4162-99ce-1492d873f1df admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.767808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.767808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.767808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.767808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.769826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.773544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:32.810293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1028/2073] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:32 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:32.813925 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.825728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e25ed-ec34-41fb-aa7f-6e269938c25b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.831102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.832378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.832913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.833404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.834411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.836350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:32.848676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1046/2074] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:32.862139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.882604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c7b8-a646-4226-8548-c71764dce04d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.896538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400710d6-684f-499e-a190-a5d0211525e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.897783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400710d6-684f-499e-a190-a5d0211525e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.898329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400710d6-684f-499e-a190-a5d0211525e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.898837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400710d6-684f-499e-a190-a5d0211525e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.900006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400710d6-684f-499e-a190-a5d0211525e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.902339 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400710d6-684f-499e-a190-a5d0211525e9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:32.922319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1029/2075] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:32.923271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:32.939266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82993e-ca5d-4463-97b2-6cfd57c39ae1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:32.947850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:32.949042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:32.949495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:32.949963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] PATH_INFO: `/v3/projects/bbbd57ed0ffb4a07bfdc51d2d8a82284/users/b50587fba1ae41d99d42a7eb6e90b632/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:32.961609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:32.977378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbd57ed0ffb4a07bfdc51d2d8a82284, user_id=b50587fba1ae41d99d42a7eb6e90b632, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:32.980521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:33.018804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e4f6-ade5-4116-9e99-47f447ff1a44 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:33.019262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e4f6-ade5-4116-9e99-47f447ff1a44 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:33.019596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e4f6-ade5-4116-9e99-47f447ff1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:33.021900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1047/2076] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:32 2022] PUT /identity/v3/projects/bbbd57ed0ffb4a07bfdc51d2d8a82284/users/b50587fba1ae41d99d42a7eb6e90b632/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:33.067370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8297e4f6-ade5-4116-9e99-47f447ff1a44 None None] MFA Rules not processed for user `b50587fba1ae41d99d42a7eb6e90b632`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:33.069110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8297e4f6-ade5-4116-9e99-47f447ff1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:33.176533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1030/2077] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:33.188906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:33.193336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:33.314462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37d13e-c5ec-477d-bd3e-1a1ea6af33b9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:33.324991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:33.326683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:33.329369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:33.329573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:33.348305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:33.350376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:33.365895 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1048/2078] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:34.927785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa4360-4287-404b-af8b-75563e13d382 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:34.928257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa4360-4287-404b-af8b-75563e13d382 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:34.928370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa4360-4287-404b-af8b-75563e13d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:34.935123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:34.957990 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-28aa4360-4287-404b-af8b-75563e13d382 None None] MFA Rules not processed for user `3f32dbffd0de4970bc8d77048a9b472f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:34.959225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-28aa4360-4287-404b-af8b-75563e13d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:35.086294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1031/2079] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:35.098312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:35.099920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:35.186833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff85d-f378-4b57-8080-937867f663e2 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:35.186833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:35.188227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:35.188737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:35.200448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:35.203981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:35.308206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:35.309919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:35.334623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1049/2080] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:35.576309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:35.578754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:35.579242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:35.631300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:35.632727 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:35.715997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1032/2081] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:37:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:35.729948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:35.732639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:35.830189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:35.915147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b408-68dd-4d0a-8fd8-3ff9cf4a39f6 service glance] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:35.920483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95862-df43-4c1b-aabc-90d0c5554f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:35.921159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95862-df43-4c1b-aabc-90d0c5554f4f service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:35.921443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95862-df43-4c1b-aabc-90d0c5554f4f service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:35.921720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95862-df43-4c1b-aabc-90d0c5554f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:35.932355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad95862-df43-4c1b-aabc-90d0c5554f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:35.942737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad95862-df43-4c1b-aabc-90d0c5554f4f service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:35.952135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1050/2082] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:36.487650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:36.608661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b312f-ec87-4fa7-b64d-6a8fe455b4b5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:36.613873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:36.614847 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:36.615201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:36.615548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] PATH_INFO: `/v3/users/b50587fba1ae41d99d42a7eb6e90b632` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:36.616884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50587fba1ae41d99d42a7eb6e90b632)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:36.619002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:36.669987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:36.683020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50587fba1ae41d99d42a7eb6e90b632'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:36.696015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50587fba1ae41d99d42a7eb6e90b632'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:36.721163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50587fba1ae41d99d42a7eb6e90b632'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:36.729722 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50587fba1ae41d99d42a7eb6e90b632'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:36.743078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50587fba1ae41d99d42a7eb6e90b632'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:36.774363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1033/2083] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:36 2022] DELETE /identity/v3/users/b50587fba1ae41d99d42a7eb6e90b632 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:36.799296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:36.799296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:36.799296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:36.834386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:36.835702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:36.931909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1051/2084] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:36.948989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:36.951770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:37.076480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c117-e49d-4b45-9fe5-1e2450846377 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:37.080720 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a710-1b5a-4ce5-9c61-929df90ece63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:37.081412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a710-1b5a-4ce5-9c61-929df90ece63 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:37.081924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a710-1b5a-4ce5-9c61-929df90ece63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:37.082215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a710-1b5a-4ce5-9c61-929df90ece63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:37.107502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14a710-1b5a-4ce5-9c61-929df90ece63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:37.109172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14a710-1b5a-4ce5-9c61-929df90ece63 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:37.137671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1034/2085] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:37.693301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:37.696224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:37.719148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023583af-c498-4a54-b6a0-c6847ee250cd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:37.726653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:37.727703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:37.728027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:37.728327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] PATH_INFO: `/v3/projects/bbbd57ed0ffb4a07bfdc51d2d8a82284` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:37.730302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbd57ed0ffb4a07bfdc51d2d8a82284)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:37.732854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:37.852641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbd57ed0ffb4a07bfdc51d2d8a82284', 'request_id': 'req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:37.865143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbd57ed0ffb4a07bfdc51d2d8a82284', 'request_id': 'req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:37.874888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbd57ed0ffb4a07bfdc51d2d8a82284', 'request_id': 'req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:37.896313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] The token cache is being invalidate because project bbbd57ed0ffb4a07bfdc51d2d8a82284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:37.897048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:37.898060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0ccac16c-8b95-43a5-b4e0-902818a7a2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:37.900336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1052/2086] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:37 2022] DELETE /identity/v3/projects/bbbd57ed0ffb4a07bfdc51d2d8a82284 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:37.905106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:37.905637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:37.905637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:37.940528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:37.941834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:38.029236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1035/2087] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:38.036661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.037050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.037392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.062756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:38.065165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:38.081211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1053/2088] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:38.082434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.096186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93078-78d1-4cb7-bb95-2a0cd2354377 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.101708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.102649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.102941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.103216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.104127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:38.104440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.108547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:38.129818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1036/2089] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:37:38.131230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.156615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf54-9524-4269-9d8d-3d681c207187 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.172094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.172787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.173101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.173537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.174258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.176682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:38.240504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1054/2090] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:38 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:38.244702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.256972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1973ca-a1f9-4da4-85d1-dfdc0304f957 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.330411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:38.372678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.373536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.373843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.374119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.374869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.377094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:38.434185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1037/2091] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:38 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:38.435620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.448876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34420-e726-41d9-bc7b-4cb1b8a729fa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.460006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.460924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.462404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.462721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.464016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.466398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:38.475571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:38.492407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1055/2092] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:38.493617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.519651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53329c-fce7-4fc0-8d67-0ed444d87b44 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.528822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff80a5-0e5d-4c5d-9d3e-c70c8cc063b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.529514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff80a5-0e5d-4c5d-9d3e-c70c8cc063b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.529803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff80a5-0e5d-4c5d-9d3e-c70c8cc063b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.530093 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff80a5-0e5d-4c5d-9d3e-c70c8cc063b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.531022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff80a5-0e5d-4c5d-9d3e-c70c8cc063b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.533478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff80a5-0e5d-4c5d-9d3e-c70c8cc063b7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:38.565778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1038/2093] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:38.567614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.587662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9759d-6ee5-4fa0-ab5e-fbe33b7cdffc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.596510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.597499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.597854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.598205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] PATH_INFO: `/v3/projects/ed53f8f414da4dd6b929185bc75a3d1c/users/f64e6612a58741e89f337e21e7a30703/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.618842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed53f8f414da4dd6b929185bc75a3d1c, user_id=f64e6612a58741e89f337e21e7a30703, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.621811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:38.640919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1056/2094] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:38 2022] PUT /identity/v3/projects/ed53f8f414da4dd6b929185bc75a3d1c/users/f64e6612a58741e89f337e21e7a30703/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:38.658283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.658283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.658964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.716623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] MFA Rules not processed for user `f64e6612a58741e89f337e21e7a30703`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:38.717960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:38.837160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1039/2095] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:38.844446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:38.949089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be0cd5-ad26-4eeb-867d-6cc1c715867a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:38.955775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:38.956503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:38.956777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:38.957087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:38.957912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:38.962191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:39.017317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1057/2096] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:38 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:39.021307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:39.045081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768afc66-671b-4ddb-aeea-167ca2fed280 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:39.169471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:39.170508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:39.171131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:39.171630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:39.172811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:39.175930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:39.214511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1040/2097] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:39 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:39.220291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:39.243630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aea9f-bd5e-4123-9ec0-89f2f222cfdf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:39.254261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:39.254954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:39.255236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:39.255695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:39.257191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:39.258818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:39.280908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1058/2098] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:39.282492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:39.297923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34563c6-c795-4036-87d4-9285cba5a469 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:39.318076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:39.318992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:39.319281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:39.319555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] PATH_INFO: `/v3/projects/2db6d6583edb40cd9d6c7e03667173c3/users/dbf632dc03934ccf97328796fa86e67d/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:39.376079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db6d6583edb40cd9d6c7e03667173c3, user_id=dbf632dc03934ccf97328796fa86e67d, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:39.380737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:39.427043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1041/2099] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:39 2022] PUT /identity/v3/projects/2db6d6583edb40cd9d6c7e03667173c3/users/dbf632dc03934ccf97328796fa86e67d/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:39.431149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:39.450694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586161f-bfa3-426a-87b0-420b62187cdd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:39.566385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be20426-8ebb-4202-ab8b-7fd16588300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:39.567027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20426-8ebb-4202-ab8b-7fd16588300c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:39.567990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20426-8ebb-4202-ab8b-7fd16588300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:39.568482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20426-8ebb-4202-ab8b-7fd16588300c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:39.575477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be20426-8ebb-4202-ab8b-7fd16588300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:39.579661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be20426-8ebb-4202-ab8b-7fd16588300c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:39.607260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1059/2100] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:39.608556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:39.622769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b3509-8444-41dd-bb82-13c9cc2cbf09 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:39.637928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:39.638840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:39.639123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:39.639403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] PATH_INFO: `/v3/projects/2db6d6583edb40cd9d6c7e03667173c3/users/dbf632dc03934ccf97328796fa86e67d/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:39.647069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db6d6583edb40cd9d6c7e03667173c3, user_id=dbf632dc03934ccf97328796fa86e67d, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:39.653515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:39.687635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1042/2101] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:39 2022] PUT /identity/v3/projects/2db6d6583edb40cd9d6c7e03667173c3/users/dbf632dc03934ccf97328796fa86e67d/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:39.690100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:39.690657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:39.690966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:39.796637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] MFA Rules not processed for user `dbf632dc03934ccf97328796fa86e67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:39.797942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:39.885105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:39.980475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1060/2102] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:39.993639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:39.996099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:40.010201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:40.123513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fea60-5c21-46d7-88bb-229b8260d2d6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:40.127697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910f714-2c7d-4001-ac1b-08755e915047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:40.128408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f714-2c7d-4001-ac1b-08755e915047 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:40.128695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f714-2c7d-4001-ac1b-08755e915047 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:40.128974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f714-2c7d-4001-ac1b-08755e915047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:40.141840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f714-2c7d-4001-ac1b-08755e915047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:40.143522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f714-2c7d-4001-ac1b-08755e915047 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:40.173670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1043/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:42.149601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:42.238851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a146ad-55c1-4b3a-8ee8-aae5c3c568e6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:42.244527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:42.245730 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:42.246772 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:42.247272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] PATH_INFO: `/v3/users/f64e6612a58741e89f337e21e7a30703` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:42.248749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64e6612a58741e89f337e21e7a30703)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:42.250921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:42.353762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64e6612a58741e89f337e21e7a30703'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:42.365020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64e6612a58741e89f337e21e7a30703'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:42.386735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64e6612a58741e89f337e21e7a30703'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:42.388201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64e6612a58741e89f337e21e7a30703'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:42.397280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64e6612a58741e89f337e21e7a30703'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:42.404683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1061/2104] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:42 2022] DELETE /identity/v3/users/f64e6612a58741e89f337e21e7a30703 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:42.409824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c15377-5326-4101-83b5-9455160f70da None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:42.410382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c15377-5326-4101-83b5-9455160f70da None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:42.410485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c15377-5326-4101-83b5-9455160f70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:42.430872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-21c15377-5326-4101-83b5-9455160f70da None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:42.433079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-21c15377-5326-4101-83b5-9455160f70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:42.504853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1044/2105] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:42.515010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:42.517831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:42.601044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7929b6f-644d-4ab1-b8a1-1e5be4165016 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:42.605032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:42.608333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:42.608812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:42.609971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:42.619074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:42.627043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:42.629243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:42.642700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1062/2106] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:43.065658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c15377-5326-4101-83b5-9455160f70da None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:43.075030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-21c15377-5326-4101-83b5-9455160f70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:43.111254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c15377-5326-4101-83b5-9455160f70da None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:43.188389 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:43.189394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:43.189710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:43.190543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] PATH_INFO: `/v3/projects/ed53f8f414da4dd6b929185bc75a3d1c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:43.192204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed53f8f414da4dd6b929185bc75a3d1c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:43.203972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:43.298260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed53f8f414da4dd6b929185bc75a3d1c', 'request_id': 'req-47b8ccb3-19d1-468b-922c-29911df1d9a4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.310983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed53f8f414da4dd6b929185bc75a3d1c', 'request_id': 'req-47b8ccb3-19d1-468b-922c-29911df1d9a4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.318324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed53f8f414da4dd6b929185bc75a3d1c', 'request_id': 'req-47b8ccb3-19d1-468b-922c-29911df1d9a4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.337163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] The token cache is being invalidate because project ed53f8f414da4dd6b929185bc75a3d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:43.337456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.338129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.342631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1045/2107] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:43 2022] DELETE /identity/v3/projects/ed53f8f414da4dd6b929185bc75a3d1c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:43.344050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:43.368296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeed4-9b4a-4b8c-869f-7082ab1e713f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:43.532486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:43.533621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:43.533913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:43.534185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] PATH_INFO: `/v3/users/dbf632dc03934ccf97328796fa86e67d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:43.536711 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf632dc03934ccf97328796fa86e67d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:43.538879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:43.597792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf632dc03934ccf97328796fa86e67d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.607743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf632dc03934ccf97328796fa86e67d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.625226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf632dc03934ccf97328796fa86e67d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.626839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf632dc03934ccf97328796fa86e67d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.637382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a0cc7285-17af-46cf-a875-40ba3cf67920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf632dc03934ccf97328796fa86e67d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:43.660109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1063/2108] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:43 2022] DELETE /identity/v3/users/dbf632dc03934ccf97328796fa86e67d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:44.060719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.063004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:44.081733 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ccb3-19d1-468b-922c-29911df1d9a4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.121762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:44.170649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.173972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.174261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.174520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] PATH_INFO: `/v3/projects/2db6d6583edb40cd9d6c7e03667173c3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.176118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db6d6583edb40cd9d6c7e03667173c3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.178057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.247092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db6d6583edb40cd9d6c7e03667173c3', 'request_id': 'req-d4f1b6c2-3747-476e-9394-93b05f2752fe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:44.258436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db6d6583edb40cd9d6c7e03667173c3', 'request_id': 'req-d4f1b6c2-3747-476e-9394-93b05f2752fe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:44.265226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db6d6583edb40cd9d6c7e03667173c3', 'request_id': 'req-d4f1b6c2-3747-476e-9394-93b05f2752fe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:44.285159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] The token cache is being invalidate because project 2db6d6583edb40cd9d6c7e03667173c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:44.285810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:44.286865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d4f1b6c2-3747-476e-9394-93b05f2752fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:44.289277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1046/2109] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:44 2022] DELETE /identity/v3/projects/2db6d6583edb40cd9d6c7e03667173c3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:44.294502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.294868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.295220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.318011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:44.319248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:44.395572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1064/2110] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:44.404115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.405217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.405726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.427973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:44.429198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:44.440051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1047/2111] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:44.446249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.460653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b204c12-009c-473d-92f9-a7124f03c483 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.468312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.468999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.469277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.469557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.470293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:44.470595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.472251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.482744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:44.493865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1065/2112] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:44.495597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.505968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339e9d-248a-4925-a8bc-24a4cf8292ec None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.515259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.515966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.516505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.516778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.517476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.519379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.561439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1048/2113] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:44 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:44.563028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.573344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1950d2-66b6-47b4-9358-e94e62b25b0b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.653038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.653903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.654298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.654692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.655532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.657944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.688511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1066/2114] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:44 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:44.693060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.708429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c953e6e-242f-4aea-9d73-c3c414a178e8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.714358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.715233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.715984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.716378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.717348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.719396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.736761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1049/2115] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:44.740850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.753283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222d1e-d986-4e67-9947-cedb1e12e87a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.759199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e379d3-1052-4e31-8e51-aa98d906790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.759938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e379d3-1052-4e31-8e51-aa98d906790c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.760227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e379d3-1052-4e31-8e51-aa98d906790c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.760507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e379d3-1052-4e31-8e51-aa98d906790c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.761326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e379d3-1052-4e31-8e51-aa98d906790c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.781574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e379d3-1052-4e31-8e51-aa98d906790c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.800393 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1067/2116] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:44.801690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:44.823835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbd830-1af6-4f32-b833-032e67237dbf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:44.840969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:44.842097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.842631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.843020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] PATH_INFO: `/v3/projects/f4bc09abbd0a41b4b85a1af92f7ef658/users/76e5eba529eb4f4aaf22d138254e8c71/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.864628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bc09abbd0a41b4b85a1af92f7ef658, user_id=76e5eba529eb4f4aaf22d138254e8c71, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:44.867298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:44.883628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1050/2117] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:44 2022] PUT /identity/v3/projects/f4bc09abbd0a41b4b85a1af92f7ef658/users/76e5eba529eb4f4aaf22d138254e8c71/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:44.897279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:44.897570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:44.897852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:44.930838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] MFA Rules not processed for user `76e5eba529eb4f4aaf22d138254e8c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:44.935532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:45.029971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1068/2118] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:45.031208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.139273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:45.148281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4c362-9d55-4ced-8c6f-305cb953cc9e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.155459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.156611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.156992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.157366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.158832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:45.161228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:45.200620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1051/2119] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:45 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:45.201906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.219388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fadb6b-964a-428a-91a3-30f44021f5f8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.309947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.310653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.310948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.311275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.312270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:45.314180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:45.340485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:45.352195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1069/2120] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:45 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:45.357061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.374954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d65cd6-0a91-488e-82b2-839641cbd181 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.382252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.383705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.384214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.384698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.385745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:45.388912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:45.411015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1052/2121] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:45.417435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.433884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906fa12-e65d-4cee-bba2-b74d1d9faead admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.439360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.440435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.440827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.441284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] PATH_INFO: `/v3/projects/4bcb6bb8cea046c498a32e5147554de1/users/8288a91074a04fa0944be29a8157944e/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.463177 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb6bb8cea046c498a32e5147554de1, user_id=8288a91074a04fa0944be29a8157944e, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:45.467200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:45.491244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.498029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1070/2122] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:45 2022] PUT /identity/v3/projects/4bcb6bb8cea046c498a32e5147554de1/users/8288a91074a04fa0944be29a8157944e/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:45.505412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81af3b-bbdf-407a-bf0a-b73451eae9a2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.602073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ea6bc-c907-4cb2-9518-106c50642940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.602773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ea6bc-c907-4cb2-9518-106c50642940 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.603063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ea6bc-c907-4cb2-9518-106c50642940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.603342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ea6bc-c907-4cb2-9518-106c50642940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.604114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ea6bc-c907-4cb2-9518-106c50642940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:45.605911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ea6bc-c907-4cb2-9518-106c50642940 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:45.619801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1053/2123] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:45.621266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.632565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6920-e132-482f-ba5a-d01652cb15a3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.639926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.642160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.642160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.642160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] PATH_INFO: `/v3/projects/4bcb6bb8cea046c498a32e5147554de1/users/8288a91074a04fa0944be29a8157944e/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.644226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb6bb8cea046c498a32e5147554de1, user_id=8288a91074a04fa0944be29a8157944e, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:45.646907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:45.663157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1071/2124] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:45 2022] PUT /identity/v3/projects/4bcb6bb8cea046c498a32e5147554de1/users/8288a91074a04fa0944be29a8157944e/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:45.678366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11f08-3f9d-434e-a855-222da997380e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.678755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11f08-3f9d-434e-a855-222da997380e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.678979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11f08-3f9d-434e-a855-222da997380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:45.714921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dec11f08-3f9d-434e-a855-222da997380e None None] MFA Rules not processed for user `8288a91074a04fa0944be29a8157944e`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:45.716195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dec11f08-3f9d-434e-a855-222da997380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:45.810906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1054/2125] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:45.823394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:45.835066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:45.930592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85594177-6d95-461e-80bd-cff63a9056a4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:45.934353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:45.935002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:45.935284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:45.935560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:46.073990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:46.076074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:46.093737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1072/2126] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:47.534454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2070c-ce73-426f-9ece-b0f88023fd8c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:47.535090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2070c-ce73-426f-9ece-b0f88023fd8c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:47.535090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2070c-ce73-426f-9ece-b0f88023fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:47.553673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-32f2070c-ce73-426f-9ece-b0f88023fd8c None None] MFA Rules not processed for user `07f3f6934b3b4e759a25562064a5e4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:47.554927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-32f2070c-ce73-426f-9ece-b0f88023fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:47.602955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:47.615894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1055/2127] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:47.625939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:47.627525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:47.639672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40d9f8-0f48-4fae-bed9-8d7fe7017dc4 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:47.643614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:47.644409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:47.644822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:47.645261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:47.660695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:47.662185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:47.674221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1073/2128] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:50.584679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:50.585203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:50.585470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:50.604119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:50.606263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:50.668356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1056/2129] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:50.680962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:50.682535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:50.763317 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef1458-3629-4e2b-a025-a3da876f844a service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:50.764495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:50.770756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f55752-32ff-4bcd-8533-1d21038561a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:50.771427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f55752-32ff-4bcd-8533-1d21038561a8 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:50.771867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f55752-32ff-4bcd-8533-1d21038561a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:50.772227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f55752-32ff-4bcd-8533-1d21038561a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:50.782648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f55752-32ff-4bcd-8533-1d21038561a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:50.785046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f55752-32ff-4bcd-8533-1d21038561a8 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:50.795840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1074/2130] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:51.786547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:51.938778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469913eb-d1c4-46b0-a8a4-0c108986d1f5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:51.946636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:51.948194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:51.948894 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:51.949846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] PATH_INFO: `/v3/users/76e5eba529eb4f4aaf22d138254e8c71` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:51.952325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e5eba529eb4f4aaf22d138254e8c71)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:51.964829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:52.032718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e5eba529eb4f4aaf22d138254e8c71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.041566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e5eba529eb4f4aaf22d138254e8c71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.054836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e5eba529eb4f4aaf22d138254e8c71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.055546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e5eba529eb4f4aaf22d138254e8c71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.063190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e5eba529eb4f4aaf22d138254e8c71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.069568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1057/2131] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:51 2022] DELETE /identity/v3/users/76e5eba529eb4f4aaf22d138254e8c71 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:52.075757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:52.076343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:52.076476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:52.107934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:52.109284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:52.173185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1075/2132] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:52.184076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:52.185516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:52.218154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:52.274234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a2c7-8506-4631-aec0-11d8300194e6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:52.278560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:52.279221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:52.279506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:52.279811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:52.290027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:52.291477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:52.302188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1058/2133] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:52.598212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:52.599757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:52.621569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb3c4b-bd23-40f4-8f86-31dc72efa60e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:52.627706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:52.628616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:52.628900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:52.629171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] PATH_INFO: `/v3/projects/f4bc09abbd0a41b4b85a1af92f7ef658` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:52.630377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bc09abbd0a41b4b85a1af92f7ef658)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:52.632364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:52.683445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bc09abbd0a41b4b85a1af92f7ef658', 'request_id': 'req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.690983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bc09abbd0a41b4b85a1af92f7ef658', 'request_id': 'req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.697292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bc09abbd0a41b4b85a1af92f7ef658', 'request_id': 'req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.708790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] The token cache is being invalidate because project f4bc09abbd0a41b4b85a1af92f7ef658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:52.709080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.709788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.711415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1076/2134] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:52 2022] DELETE /identity/v3/projects/f4bc09abbd0a41b4b85a1af92f7ef658 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:52.716153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:52.725914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b41e7-c9ba-45c7-9391-0691bfc4cdb6 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:52.805583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:52.807123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:52.828212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:52.828212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:52.828212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:52.828212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] PATH_INFO: `/v3/users/8288a91074a04fa0944be29a8157944e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:52.830095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8288a91074a04fa0944be29a8157944e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:52.831814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:52.903002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8288a91074a04fa0944be29a8157944e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.912820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8288a91074a04fa0944be29a8157944e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.915230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa6fbf-d1aa-4d90-9766-d69fae875f3a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:52.920497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:52.921403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:52.921686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:52.921966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] PATH_INFO: `/v3/users/735191bfd1a3479cbd4d395355e72e18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:52.923229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] RBAC: Authorizing `identity:delete_user(user_id=735191bfd1a3479cbd4d395355e72e18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:52.925454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:52.953520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:52.959761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8288a91074a04fa0944be29a8157944e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.961517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8288a91074a04fa0944be29a8157944e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.973616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b6f20f82-058c-4962-b2d4-ac20e004a6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8288a91074a04fa0944be29a8157944e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:52.980797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1059/2135] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:52 2022] DELETE /identity/v3/users/8288a91074a04fa0944be29a8157944e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:53.047488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735191bfd1a3479cbd4d395355e72e18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.062453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735191bfd1a3479cbd4d395355e72e18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.124288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735191bfd1a3479cbd4d395355e72e18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.124940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735191bfd1a3479cbd4d395355e72e18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.138427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735191bfd1a3479cbd4d395355e72e18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.154154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1077/2136] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:52 2022] DELETE /identity/v3/users/735191bfd1a3479cbd4d395355e72e18 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:53.159708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.160080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.167568 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.220295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:53.221715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:53.312080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:53.335805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1060/2137] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:53.346584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:53.348162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:53.455839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:53.457366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:53.458362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705786b0-f6ae-4112-812f-56736eda586b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:53.466213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c3b7-17f6-4b12-acf3-3d755858e673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:53.466213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c3b7-17f6-4b12-acf3-3d755858e673 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.466213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c3b7-17f6-4b12-acf3-3d755858e673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.466213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c3b7-17f6-4b12-acf3-3d755858e673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.489351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db1d4-c14b-43f5-a0ed-702ece146520 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:53.494994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:53.494994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.494994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.494994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] PATH_INFO: `/v3/projects/4bcb6bb8cea046c498a32e5147554de1` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.497690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcb6bb8cea046c498a32e5147554de1)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:53.499972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:53.501537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c3b7-17f6-4b12-acf3-3d755858e673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:53.503638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c3b7-17f6-4b12-acf3-3d755858e673 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:53.528942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1078/2138] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:53.573421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcb6bb8cea046c498a32e5147554de1', 'request_id': 'req-5a045439-ddaf-424b-88ef-e837ce05941a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.583563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcb6bb8cea046c498a32e5147554de1', 'request_id': 'req-5a045439-ddaf-424b-88ef-e837ce05941a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.589608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcb6bb8cea046c498a32e5147554de1', 'request_id': 'req-5a045439-ddaf-424b-88ef-e837ce05941a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.605773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] The token cache is being invalidate because project 4bcb6bb8cea046c498a32e5147554de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:53.606417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.607239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5a045439-ddaf-424b-88ef-e837ce05941a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.609166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1061/2139] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:53 2022] DELETE /identity/v3/projects/4bcb6bb8cea046c498a32e5147554de1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:53.615103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.616266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.616669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.644291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:53.645552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:53.741105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1079/2140] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:53.750473 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.750763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.751042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.770202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:53.771424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:53.798929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1062/2141] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:53.806286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:53.819169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73874ed1-901e-4e82-bbc8-48bded74644d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:53.829881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:53.830740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.831166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.831571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.832518 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:53.833489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:53.834759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:53.863651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1080/2142] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:53.868440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:53.877312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:53.879195 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:53.880726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc1b17-6433-44ab-8fb5-a0a95135629f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:53.894656 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10415-766f-47a2-854c-0d1577452000 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:53.895187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:53.895931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.896210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.896482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.897170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:53.899098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:53.908863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:53.909924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:53.910362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:53.910811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] PATH_INFO: `/v3/projects/e2df15d657e9430286334148a9d1b837` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:53.912478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2df15d657e9430286334148a9d1b837)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:53.920274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:53.944172 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1063/2143] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:53 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:53.946594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:53.952452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:53.985873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2df15d657e9430286334148a9d1b837', 'request_id': 'req-59774ab7-816e-4a12-8d56-ade9d71d4afe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:53.994155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2df15d657e9430286334148a9d1b837', 'request_id': 'req-59774ab7-816e-4a12-8d56-ade9d71d4afe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:54.001643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2df15d657e9430286334148a9d1b837', 'request_id': 'req-59774ab7-816e-4a12-8d56-ade9d71d4afe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:54.013920 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] The token cache is being invalidate because project e2df15d657e9430286334148a9d1b837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:54.014153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:54.014843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-59774ab7-816e-4a12-8d56-ade9d71d4afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:54.019504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1081/2144] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:53 2022] DELETE /identity/v3/projects/e2df15d657e9430286334148a9d1b837 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:54.024294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e799-3baa-4474-bb2a-1a28290d99d6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.024660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e799-3baa-4474-bb2a-1a28290d99d6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.025037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e799-3baa-4474-bb2a-1a28290d99d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.043901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29a765-3f5c-4baa-9a15-15af65bb8164 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.046954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce41e799-3baa-4474-bb2a-1a28290d99d6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:54.048385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce41e799-3baa-4474-bb2a-1a28290d99d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:54.103151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:54.131395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.132241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.132593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.133003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.133859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.135873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.141496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1082/2145] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:54.149548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.149962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.150310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.179790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:54.180140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1064/2146] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:53 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:54.180218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:54.187543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1083/2147] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:54.191969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.194382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.196143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:54.205914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c008-fe45-4b94-9de4-aa24adca5da1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.208674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df79a-d8d0-47e4-bdec-ab4f63781d02 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.210986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.211651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.211973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.212256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.212993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:54.213295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.214095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.215411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.215525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.215852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.216280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.217347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.219323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.243500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1084/2148] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:54.251743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1065/2149] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:54.251968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.252068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.266788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9fc5-16ea-4ab5-9b36-4bc67c4d8241 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.267264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f73c-288e-4c64-956e-f35a94ea8eab admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.272615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.273012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.273787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.273934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.274189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.274531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.274663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.275082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.275842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.278540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.280489 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.282287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.294661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1066/2150] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:54.299222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.310256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7737a46-2093-481a-8c6a-28a5053afa62 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.311891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1085/2151] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:54.314484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.403300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a135cf-0ed3-4fab-8d42-8b03a645c6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.404335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a135cf-0ed3-4fab-8d42-8b03a645c6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.404620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a135cf-0ed3-4fab-8d42-8b03a645c6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.405099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a135cf-0ed3-4fab-8d42-8b03a645c6ad admin admin] PATH_INFO: `/v3/projects/b38982943570498483124b2e69d6673c/users/b6cfe10e7c314c80af238164fcd662d3/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.427354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a135cf-0ed3-4fab-8d42-8b03a645c6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38982943570498483124b2e69d6673c, user_id=b6cfe10e7c314c80af238164fcd662d3, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.430557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a135cf-0ed3-4fab-8d42-8b03a645c6ad admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.443980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dcf5-ef7b-43b7-9efd-3fa10d2b550f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.455829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1067/2152] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:54 2022] PUT /identity/v3/projects/b38982943570498483124b2e69d6673c/users/b6cfe10e7c314c80af238164fcd662d3/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:54.465192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.465192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.465485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.477063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:54.512051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] MFA Rules not processed for user `b6cfe10e7c314c80af238164fcd662d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:54.513594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:54.580407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.581298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.581795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.582081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.593028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.595255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.631035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1086/2153] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:54.636008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.651070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1068/2154] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:54.657534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.667260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1ed5-0a94-4a32-8059-27dc79bbd9f9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.672873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085e3dd-5373-4eea-bc66-9121a116f920 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.675428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.676258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.676550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.676831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.678034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.679867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.680743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.680924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.681494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.681952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.683272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.685941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.694253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1087/2155] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:54.699488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.713808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd28446-bcb8-4ea7-bac3-bbbc650f95a6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.720246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.720943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.720943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.724001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1069/2156] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:54.724085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.724085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.724085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.726945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.731559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:54.740022 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1088/2157] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:54.741245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.754472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04197adc-48f9-4ff5-a9a3-db0201686860 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.843487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f85d-106d-48ac-b66f-89f0f76508df admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.849139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.849841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.850146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.850424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.851146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.853152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.858539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae5a7-0def-4370-81b7-ad837e9cac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.859941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae5a7-0def-4370-81b7-ad837e9cac1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.860554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae5a7-0def-4370-81b7-ad837e9cac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.860836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae5a7-0def-4370-81b7-ad837e9cac1e admin admin] PATH_INFO: `/v3/projects/f3e0cea8289c4431b2f0cc45dd612dfd/users/dfb8fbca0f514f9186ac997b83ff700e/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.877864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1070/2158] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:54.887067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.890118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae5a7-0def-4370-81b7-ad837e9cac1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0cea8289c4431b2f0cc45dd612dfd, user_id=dfb8fbca0f514f9186ac997b83ff700e, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.893350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae5a7-0def-4370-81b7-ad837e9cac1e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.898980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183d9e-8f25-455b-9d04-4e378eb3b40b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.905600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:54.906287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.906575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.906853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.907588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:54.909237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:54.911522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1089/2159] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:54 2022] PUT /identity/v3/projects/f3e0cea8289c4431b2f0cc45dd612dfd/users/dfb8fbca0f514f9186ac997b83ff700e/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:54.922185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:54.922520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:54.922857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:54.926399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1071/2160] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:54.932867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:54.955186 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ca4c2-0218-4388-912c-e124e98e211f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:54.957633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] MFA Rules not processed for user `dfb8fbca0f514f9186ac997b83ff700e`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:54.958944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:55.039829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:55.048857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:55.049801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.050091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.050384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] PATH_INFO: `/v3/projects/e5d85aeee8664f70a3e38a235e0e213b/users/ae2e5013583646fd8d325e975c7d8d82/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.059039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1090/2161] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:55.069750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d85aeee8664f70a3e38a235e0e213b, user_id=ae2e5013583646fd8d325e975c7d8d82, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:55.072184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:55.072888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:55.074453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:55.099202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1072/2162] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:54 2022] PUT /identity/v3/projects/e5d85aeee8664f70a3e38a235e0e213b/users/ae2e5013583646fd8d325e975c7d8d82/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:55.103944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:55.143617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83f1d5-5e3f-4d6e-a4e2-d1fddec64bd0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:55.221411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764c9e0-63af-4f84-b17e-acf94e8ad649 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:55.226538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:55.227459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.227941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.228053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.228808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:55.231100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:55.232894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:55.233572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.233856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.234134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.238890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:55.245459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1073/2163] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:55.252893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:55.265849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e2f9a-fd9a-48f6-aab3-77ae4bea06e1 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:55.274837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3acdc-3fb7-415a-a1a8-47f9ac5f023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:55.276129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3acdc-3fb7-415a-a1a8-47f9ac5f023c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.276418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3acdc-3fb7-415a-a1a8-47f9ac5f023c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.276803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3acdc-3fb7-415a-a1a8-47f9ac5f023c admin admin] PATH_INFO: `/v3/projects/e5d85aeee8664f70a3e38a235e0e213b/users/ae2e5013583646fd8d325e975c7d8d82/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.281200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3acdc-3fb7-415a-a1a8-47f9ac5f023c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d85aeee8664f70a3e38a235e0e213b, user_id=ae2e5013583646fd8d325e975c7d8d82, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:55.285253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3acdc-3fb7-415a-a1a8-47f9ac5f023c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:55.301991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1074/2164] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:55 2022] PUT /identity/v3/projects/e5d85aeee8664f70a3e38a235e0e213b/users/ae2e5013583646fd8d325e975c7d8d82/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:55.313099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.313394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.313800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.320949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:55.322613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:55.333014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1091/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:37:55.343141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] MFA Rules not processed for user `ae2e5013583646fd8d325e975c7d8d82`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:55.344541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:55.456091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1075/2166] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:55.465149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:55.466734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:55.485374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96889dae-b3a9-4438-9486-17c2ee4b628d service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:55.559080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a609f-58b6-4c03-b25a-5a031d8c6cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:55.559874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a609f-58b6-4c03-b25a-5a031d8c6cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.560138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a609f-58b6-4c03-b25a-5a031d8c6cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.560455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a609f-58b6-4c03-b25a-5a031d8c6cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.572302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a609f-58b6-4c03-b25a-5a031d8c6cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:55.574756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a609f-58b6-4c03-b25a-5a031d8c6cb1 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:55.590784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1092/2167] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:55.669333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:55.790880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4942-7eb0-4d03-bfaa-a6c88661f4c4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:55.814062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:55.814981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.815268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.815576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] PATH_INFO: `/v3/users/b6cfe10e7c314c80af238164fcd662d3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.818567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6cfe10e7c314c80af238164fcd662d3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:55.823285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:55.917463 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6cfe10e7c314c80af238164fcd662d3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:55.930586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6cfe10e7c314c80af238164fcd662d3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:55.944196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6cfe10e7c314c80af238164fcd662d3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:55.945008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6cfe10e7c314c80af238164fcd662d3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:55.947042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:55.954238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6cfe10e7c314c80af238164fcd662d3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:55.961015 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1076/2168] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:55 2022] DELETE /identity/v3/users/b6cfe10e7c314c80af238164fcd662d3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:55.966855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:55.967259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:55.967610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:55.982488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:55.987068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:55.988322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:56.105096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1093/2169] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:56.127084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:56.128704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:56.194174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b77b8-7676-4628-ac33-60e138a1b535 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:56.199421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:56.200131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:56.200415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:56.200740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:56.232213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:56.233701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:56.245965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1077/2170] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:37:56.525055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:56.526710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:56.541025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a477-7499-447e-aca1-ab3e7928e57a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:56.548527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:56.549494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:56.550039 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:56.550174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] PATH_INFO: `/v3/projects/b38982943570498483124b2e69d6673c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:56.551489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38982943570498483124b2e69d6673c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:56.553481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:56.622287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38982943570498483124b2e69d6673c', 'request_id': 'req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.629809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38982943570498483124b2e69d6673c', 'request_id': 'req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.635375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38982943570498483124b2e69d6673c', 'request_id': 'req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.647064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] The token cache is being invalidate because project b38982943570498483124b2e69d6673c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:56.647344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.647999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.649582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1094/2171] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:56 2022] DELETE /identity/v3/projects/b38982943570498483124b2e69d6673c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:56.653771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:56.663674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4ea7-2d2f-4970-ad24-425df0eb602c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:56.733832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:56.737419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:56.737716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:56.738677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] PATH_INFO: `/v3/users/ae2e5013583646fd8d325e975c7d8d82` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:56.741895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2e5013583646fd8d325e975c7d8d82)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:56.745414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:56.810190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2e5013583646fd8d325e975c7d8d82'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.819846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2e5013583646fd8d325e975c7d8d82'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.835321 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2e5013583646fd8d325e975c7d8d82'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.836198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2e5013583646fd8d325e975c7d8d82'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.843932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a72aa555-951d-459d-a439-39d621311fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2e5013583646fd8d325e975c7d8d82'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:56.850419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1078/2172] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:37:56 2022] DELETE /identity/v3/users/ae2e5013583646fd8d325e975c7d8d82 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:57.366538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:57.368201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:57.384845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddc8b-9132-4a94-bb63-cdc7b69c40b1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:57.459952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:57.461135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.461636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.461922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] PATH_INFO: `/v3/projects/e5d85aeee8664f70a3e38a235e0e213b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.463509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d85aeee8664f70a3e38a235e0e213b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:57.474012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:57.534473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:57.552701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d85aeee8664f70a3e38a235e0e213b', 'request_id': 'req-05d00136-b83c-4d68-a19d-6508837970bd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:57.561338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d85aeee8664f70a3e38a235e0e213b', 'request_id': 'req-05d00136-b83c-4d68-a19d-6508837970bd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:57.567978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d85aeee8664f70a3e38a235e0e213b', 'request_id': 'req-05d00136-b83c-4d68-a19d-6508837970bd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:57.579208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] The token cache is being invalidate because project e5d85aeee8664f70a3e38a235e0e213b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:37:57.579488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:57.580197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-05d00136-b83c-4d68-a19d-6508837970bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:37:57.581714 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1095/2173] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:37:57 2022] DELETE /identity/v3/projects/e5d85aeee8664f70a3e38a235e0e213b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:57.586659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.587207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.587313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.607452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:57.609234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:57.625334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:57.706690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1079/2174] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:57.717591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.718019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.718392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.750396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:57.751554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:57.759675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1096/2175] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:37:57.763970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:57.774581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06f8f3-8d79-45c9-97bb-c48e0bd3ef2d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:57.779997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:57.780661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.780944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.781222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.781954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:37:57.782262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:57.783922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:57.796231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1080/2176] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:37:57.801023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:57.810645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12c5e-8f15-417c-b1b4-ff4350b4d176 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:57.815502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:57.816192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.816474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.816747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.817573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:57.819538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:57.854355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1097/2177] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:57 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:57.859547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:57.871114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37acdfc-d8ee-4bee-8e2b-e08ec9716943 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:57.933361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:57.934036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.934318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.934624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.935308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:57.937241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:57.957465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1081/2178] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:57 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:37:57.962717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:57.977726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ff5ae-08a0-46e4-9e04-114d272edb62 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:57.985158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:57.986156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:57.986599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:57.987032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:57.988018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:57.989998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.006375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1098/2179] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:58.007051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.019484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dd2ef-20d7-48f4-b559-c1fd32a1be8a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.029925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155f46-51f1-41f9-8232-ad53bf9e392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.030899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155f46-51f1-41f9-8232-ad53bf9e392d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.031285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155f46-51f1-41f9-8232-ad53bf9e392d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.031796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155f46-51f1-41f9-8232-ad53bf9e392d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.032769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05155f46-51f1-41f9-8232-ad53bf9e392d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.034554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05155f46-51f1-41f9-8232-ad53bf9e392d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.049355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1082/2180] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:58.053776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.064713 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e384-849d-48a9-999a-caac34fd57b5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.069902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.070793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.071086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.071367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] PATH_INFO: `/v3/projects/a8024beb760348b0b32b257a4952914e/users/bebfad3995bf47139810af28bb9fd7c7/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.086303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8024beb760348b0b32b257a4952914e, user_id=bebfad3995bf47139810af28bb9fd7c7, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.089110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.127839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1099/2181] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:58 2022] PUT /identity/v3/projects/a8024beb760348b0b32b257a4952914e/users/bebfad3995bf47139810af28bb9fd7c7/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:58.139427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.139846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.140226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.173407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] MFA Rules not processed for user `bebfad3995bf47139810af28bb9fd7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:58.174317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:58.250047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1083/2182] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:58.254780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.371161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af8eb-acf8-46b6-ba94-ba564a0f79e1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.375956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.376666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.376949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.377221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.377930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.379881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.425740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1100/2183] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:37:58 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:58.430225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.444715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633790e-9f20-4845-a432-b09210e86bfc None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.451516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:58.520890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.521496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.521780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.522056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.522750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.525119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.577924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1084/2184] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:37:58 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:37:58.582106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.616085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b6fca-8f92-4e02-b39f-4faa8ebca2c1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.643357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.644789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.645051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.645334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.646135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.648006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.660863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1101/2185] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:37:58.664828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.675116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd19f-78a4-4867-a7d0-c7b3e680c059 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.679818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.680702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.680981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.681254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] PATH_INFO: `/v3/projects/453cc877a08c48fdb38aed6dcd7cfa54/users/0de66c06ce724f58b8f5c8fa81465b63/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.699180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453cc877a08c48fdb38aed6dcd7cfa54, user_id=0de66c06ce724f58b8f5c8fa81465b63, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.702215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.718040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1085/2186] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:58 2022] PUT /identity/v3/projects/453cc877a08c48fdb38aed6dcd7cfa54/users/0de66c06ce724f58b8f5c8fa81465b63/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:37:58.722215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.733152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86894e19-c4d4-4f02-b883-4b9090d3f3b6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.765464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:58.816025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dc38d-8244-4f5c-b81e-f3901ad74193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.816744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dc38d-8244-4f5c-b81e-f3901ad74193 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.817034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dc38d-8244-4f5c-b81e-f3901ad74193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.817315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dc38d-8244-4f5c-b81e-f3901ad74193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.818146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dc38d-8244-4f5c-b81e-f3901ad74193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.821168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dc38d-8244-4f5c-b81e-f3901ad74193 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.844354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1102/2187] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:37:58.848809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:58.860387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574ca2-9e4e-47e4-aec6-1c2583d22630 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:58.865184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:58.866071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.866357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.866632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] PATH_INFO: `/v3/projects/453cc877a08c48fdb38aed6dcd7cfa54/users/0de66c06ce724f58b8f5c8fa81465b63/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.868687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=453cc877a08c48fdb38aed6dcd7cfa54, user_id=0de66c06ce724f58b8f5c8fa81465b63, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:58.871405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:58.882253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1086/2188] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:37:58 2022] PUT /identity/v3/projects/453cc877a08c48fdb38aed6dcd7cfa54/users/0de66c06ce724f58b8f5c8fa81465b63/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:37:58.897375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:58.897694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:58.898144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:58.926558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] MFA Rules not processed for user `0de66c06ce724f58b8f5c8fa81465b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:37:58.927851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:59.011835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1103/2189] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:37:59.023465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:37:59.025317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:37:59.088176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32088922-2e4c-4600-a5dd-159f3171cbeb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:37:59.091805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a63e3-bc4a-4bf2-8edf-52248d7d3c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:37:59.092482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a63e3-bc4a-4bf2-8edf-52248d7d3c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:37:59.092767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a63e3-bc4a-4bf2-8edf-52248d7d3c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:37:59.093047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a63e3-bc4a-4bf2-8edf-52248d7d3c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:37:59.157272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a63e3-bc4a-4bf2-8edf-52248d7d3c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:37:59.159913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a63e3-bc4a-4bf2-8edf-52248d7d3c05 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:37:59.172017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1087/2190] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:37:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:03.579512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:03.589969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de084-f834-4263-b1d8-b8103bd26e1c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:03.593720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:03.594462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:03.594752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:03.595032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:03.604868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:03.606400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:03.617551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1104/2191] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:07.372292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:07.373144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:07.373144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:07.408634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:07.411060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:07.440235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:07.546738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1088/2192] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:38:07.568424 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:07.570132 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:07.679244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fff22-5b08-47a7-a839-ee39232abceb service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:07.692735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49c61a-4660-426c-b829-feeb35217457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:07.693468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c61a-4660-426c-b829-feeb35217457 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:07.693943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c61a-4660-426c-b829-feeb35217457 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:07.694720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c61a-4660-426c-b829-feeb35217457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:07.706848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49c61a-4660-426c-b829-feeb35217457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:07.708969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49c61a-4660-426c-b829-feeb35217457 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:07.721169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1105/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:08.665704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:08.689300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb1a5-5da5-4322-a1a6-a61b70aab51b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:08.699826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:08.701531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:08.702303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:08.702303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] PATH_INFO: `/v3/users/bebfad3995bf47139810af28bb9fd7c7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:08.703839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebfad3995bf47139810af28bb9fd7c7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:08.707040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:08.764032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebfad3995bf47139810af28bb9fd7c7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:08.774013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebfad3995bf47139810af28bb9fd7c7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:08.787236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebfad3995bf47139810af28bb9fd7c7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:08.788003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebfad3995bf47139810af28bb9fd7c7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:08.795188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebfad3995bf47139810af28bb9fd7c7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:08.801391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1089/2194] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:38:08 2022] DELETE /identity/v3/users/bebfad3995bf47139810af28bb9fd7c7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:08.806384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:08.806896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:08.806978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:08.830108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:08.830108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:08.848697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:08.896607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1106/2195] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:08.909253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:08.911342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:09.009835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70e97-75b4-49bb-abf8-4f61f9248571 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:09.013874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:09.014554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:09.014841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:09.015118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:09.026422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:09.028306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:09.040766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1090/2196] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:09.363886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:09.365712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:09.394783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b05cf2-d292-4735-9e70-2aa38e5dc780 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:09.398643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:09.398643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:09.398643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:09.398877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] PATH_INFO: `/v3/projects/a8024beb760348b0b32b257a4952914e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:09.400234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8024beb760348b0b32b257a4952914e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:09.402825 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:09.462315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8024beb760348b0b32b257a4952914e', 'request_id': 'req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.472230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8024beb760348b0b32b257a4952914e', 'request_id': 'req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.479838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8024beb760348b0b32b257a4952914e', 'request_id': 'req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.496452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] The token cache is being invalidate because project a8024beb760348b0b32b257a4952914e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:38:09.496802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.497511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b82f3ef-fdcc-4b23-84f8-0b1445ef43b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.499244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1107/2197] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:38:09 2022] DELETE /identity/v3/projects/a8024beb760348b0b32b257a4952914e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:09.503561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:09.515548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be326ac9-9efe-49af-8a84-5b2d2691c60b service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:09.560737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:09.608315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:09.609201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:09.609483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:09.609760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] PATH_INFO: `/v3/users/0de66c06ce724f58b8f5c8fa81465b63` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:09.610969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de66c06ce724f58b8f5c8fa81465b63)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:09.612977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:09.669378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de66c06ce724f58b8f5c8fa81465b63'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.678813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de66c06ce724f58b8f5c8fa81465b63'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.692075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de66c06ce724f58b8f5c8fa81465b63'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.692805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de66c06ce724f58b8f5c8fa81465b63'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.700050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de66c06ce724f58b8f5c8fa81465b63'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:09.707061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1091/2198] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:38:09 2022] DELETE /identity/v3/users/0de66c06ce724f58b8f5c8fa81465b63 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:09.762903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c746-13be-4de7-8e54-fff156fc67c8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:09.763256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c746-13be-4de7-8e54-fff156fc67c8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:09.763460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c746-13be-4de7-8e54-fff156fc67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:09.789388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1fc1c746-13be-4de7-8e54-fff156fc67c8 None None] MFA Rules not processed for user `2c6ad0ad11944b81accd2f70a322d176`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:09.790607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1fc1c746-13be-4de7-8e54-fff156fc67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:09.867056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1108/2199] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:10.463213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:10.465199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:10.566714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381cfe-6053-4eda-9e1a-a1090f542c2c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:10.572889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:10.573822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:10.574112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:10.574391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] PATH_INFO: `/v3/projects/453cc877a08c48fdb38aed6dcd7cfa54` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:10.575743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] RBAC: Authorizing `identity:delete_project(project_id=453cc877a08c48fdb38aed6dcd7cfa54)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:10.579516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:10.658842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453cc877a08c48fdb38aed6dcd7cfa54', 'request_id': 'req-8a6d6741-187d-4888-ad10-d9bd9086382d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:10.665209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:10.670415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453cc877a08c48fdb38aed6dcd7cfa54', 'request_id': 'req-8a6d6741-187d-4888-ad10-d9bd9086382d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:10.681496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453cc877a08c48fdb38aed6dcd7cfa54', 'request_id': 'req-8a6d6741-187d-4888-ad10-d9bd9086382d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:10.695183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] The token cache is being invalidate because project 453cc877a08c48fdb38aed6dcd7cfa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:38:10.695616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:10.696410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6d6741-187d-4888-ad10-d9bd9086382d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:10.698749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1092/2200] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:38:10 2022] DELETE /identity/v3/projects/453cc877a08c48fdb38aed6dcd7cfa54 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:10.705576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:10.705864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:10.706618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:10.728380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:10.729691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:10.809101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:10.829403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1109/2201] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:10.837778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:10.838075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:10.838358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:10.857218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:10.858436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:10.867091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1093/2202] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:10.872251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:10.883090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a87edd-6451-45d7-9058-1802f4118826 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:10.888438 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:10.889133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:10.889577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:10.889967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:10.890810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:38:10.891390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:10.893073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:10.906449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1110/2203] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:38:10.911251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:10.921543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c08729-8cd6-43e5-a3ab-9906e0f98661 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:10.927844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:10.928514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:10.928797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:10.929068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:10.929757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:10.931844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:10.958371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1094/2204] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:38:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:38:10.962651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:10.974315 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c119-59ba-4514-85cf-6d54917ba30f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.041689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.042374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.042706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.043610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.044297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.046247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.069319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1111/2205] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:38:10 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:38:11.074920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.094803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502c6f3-8a95-427b-89ad-1c124e6c2d10 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.103664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.104472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.104793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.105033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.111687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.111687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.128033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1095/2206] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:38:11.133018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.149098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4167-a1d5-4743-a0ec-e3842e11d5d6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.163261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93086-2178-4be1-9427-6471c7a1ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.164242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93086-2178-4be1-9427-6471c7a1ff82 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.164544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93086-2178-4be1-9427-6471c7a1ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.164828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93086-2178-4be1-9427-6471c7a1ff82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.165575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93086-2178-4be1-9427-6471c7a1ff82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.169789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93086-2178-4be1-9427-6471c7a1ff82 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.221186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1112/2207] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:38:11.222541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.246515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ead977-a082-46a5-8efa-a9aee78ece39 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.265738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.267584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.268045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.268530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] PATH_INFO: `/v3/projects/2c845e64826a4069beb7bccaeef605f7/users/011c12f02ceb4b79ad699f9f475ca2c8/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.292678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c845e64826a4069beb7bccaeef605f7, user_id=011c12f02ceb4b79ad699f9f475ca2c8, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.297395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.346642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1096/2208] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:38:11 2022] PUT /identity/v3/projects/2c845e64826a4069beb7bccaeef605f7/users/011c12f02ceb4b79ad699f9f475ca2c8/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:38:11.367947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c71c2-710e-42bc-ab9a-9105bc55d77c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.368181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c71c2-710e-42bc-ab9a-9105bc55d77c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.368435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c71c2-710e-42bc-ab9a-9105bc55d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.403914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-090c71c2-710e-42bc-ab9a-9105bc55d77c None None] MFA Rules not processed for user `011c12f02ceb4b79ad699f9f475ca2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:11.405795 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-090c71c2-710e-42bc-ab9a-9105bc55d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:11.520867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1113/2209] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:11.526506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.594249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.594539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.594819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.635383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:11.640575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:11.660243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5af48-5a40-4419-9221-40db580c405e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.686051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.686736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.687396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.687862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.688710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.691999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.725800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:11.747334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1097/2210] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:38:11 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:38:11.754433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.778601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1114/2211] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:11.818386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.821192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:11.858581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9c44-f3b6-4e35-b653-9a4b53729e25 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.865471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.866357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.866812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.867395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.868301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.870584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.885171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:11.907761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1098/2212] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:38:11 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:38:11.911610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.925625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608eb4-46f8-4745-9100-dd2f4266103b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.926910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd8f5-e025-47ce-986f-e8a4d815eed4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.933118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.933849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.934288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.934700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:11.935433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:11.938496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:11.956228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1099/2213] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:38:11.967841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:11.984455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4409c-6b37-4834-988f-f4f09d227ec5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:11.993843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:11.996821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:11.997768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:11.998247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] PATH_INFO: `/v3/projects/20b714682db742acb489fd8e0c6271a8/users/ee0177cb6dd8467f9f0afa1a54a84b8a/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:12.023629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b714682db742acb489fd8e0c6271a8, user_id=ee0177cb6dd8467f9f0afa1a54a84b8a, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:12.026357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:12.046384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:12.046611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1100/2214] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:38:11 2022] PUT /identity/v3/projects/20b714682db742acb489fd8e0c6271a8/users/ee0177cb6dd8467f9f0afa1a54a84b8a/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:12.047468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:12.047884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:12.048279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:12.050359 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:12.060306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:12.063890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:12.078126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1115/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:38:12.138362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb75b0-21fe-40e4-a854-d03bb6a9c469 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:12.142569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac3a7b-2519-4295-8888-0bec15cdf0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:12.143253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac3a7b-2519-4295-8888-0bec15cdf0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:12.143536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac3a7b-2519-4295-8888-0bec15cdf0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:12.143838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac3a7b-2519-4295-8888-0bec15cdf0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:12.144571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac3a7b-2519-4295-8888-0bec15cdf0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:12.146160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac3a7b-2519-4295-8888-0bec15cdf0d4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:12.157193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1101/2216] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:38:12.161425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:12.171426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305b12d-72c8-4700-a023-38fe7b639848 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:12.176223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:12.177106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:12.177383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:12.177654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] PATH_INFO: `/v3/projects/20b714682db742acb489fd8e0c6271a8/users/ee0177cb6dd8467f9f0afa1a54a84b8a/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:12.179617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b714682db742acb489fd8e0c6271a8, user_id=ee0177cb6dd8467f9f0afa1a54a84b8a, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:12.182277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:12.193223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1116/2217] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:38:12 2022] PUT /identity/v3/projects/20b714682db742acb489fd8e0c6271a8/users/ee0177cb6dd8467f9f0afa1a54a84b8a/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:12.205162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22842b-1eca-406b-86ff-09b341289798 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:12.205470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22842b-1eca-406b-86ff-09b341289798 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:12.205819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22842b-1eca-406b-86ff-09b341289798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:12.232792 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9e22842b-1eca-406b-86ff-09b341289798 None None] MFA Rules not processed for user `ee0177cb6dd8467f9f0afa1a54a84b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:12.234086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9e22842b-1eca-406b-86ff-09b341289798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:12.305766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1102/2218] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:12.318303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:12.320131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:12.380372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f851-f992-48c9-82a4-04ea1444ff61 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:12.384469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:12.385135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:12.385413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:12.385688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:12.399894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:12.470565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:12.472172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:12.481748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1117/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:14.901500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:14.901961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:14.902139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:14.920548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:14.921752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:14.955931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:14.987706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1103/2220] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:15.007276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:15.071925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:15.082398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab54da9-ae2d-455f-9731-772290156528 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:15.088134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:15.090257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:15.090790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:15.091267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] PATH_INFO: `/v3/users/011c12f02ceb4b79ad699f9f475ca2c8` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:15.092728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011c12f02ceb4b79ad699f9f475ca2c8)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:15.095021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:15.103325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824b5cc-b387-4104-a731-e63f680fd82c service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:15.115469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ae4d7-9e20-433b-9815-1270972820b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:15.116262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae4d7-9e20-433b-9815-1270972820b3 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:15.116926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae4d7-9e20-433b-9815-1270972820b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:15.117206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae4d7-9e20-433b-9815-1270972820b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:15.128090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ae4d7-9e20-433b-9815-1270972820b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:15.129987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ae4d7-9e20-433b-9815-1270972820b3 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:15.142535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1118/2221] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:15.152367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011c12f02ceb4b79ad699f9f475ca2c8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:15.163057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011c12f02ceb4b79ad699f9f475ca2c8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:15.186573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011c12f02ceb4b79ad699f9f475ca2c8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:15.187443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011c12f02ceb4b79ad699f9f475ca2c8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:15.195386 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011c12f02ceb4b79ad699f9f475ca2c8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:15.201776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1104/2222] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:38:15 2022] DELETE /identity/v3/users/011c12f02ceb4b79ad699f9f475ca2c8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:38:15.206759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:15.207065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:15.207340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:15.225219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:15.226434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:15.295533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1119/2223] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:15.305376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:15.306942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:15.408118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc4f66-a613-49d3-b2a6-75bb99948784 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:15.413702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:15.416607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:15.416899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:15.417188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:15.446793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:15.451784 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:15.474831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1105/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:16.182007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:16.186130 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:16.215114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac3a6-6b6d-4546-99cf-04a2037c9c9c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:16.232226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:16.233155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:16.233444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:16.234320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] PATH_INFO: `/v3/projects/2c845e64826a4069beb7bccaeef605f7` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:16.235701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c845e64826a4069beb7bccaeef605f7)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:16.237754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:16.283299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:16.294696 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c845e64826a4069beb7bccaeef605f7', 'request_id': 'req-f7ba26c7-3efd-4354-8fec-2980cbaab96e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.302306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c845e64826a4069beb7bccaeef605f7', 'request_id': 'req-f7ba26c7-3efd-4354-8fec-2980cbaab96e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.309166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c845e64826a4069beb7bccaeef605f7', 'request_id': 'req-f7ba26c7-3efd-4354-8fec-2980cbaab96e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.325272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] The token cache is being invalidate because project 2c845e64826a4069beb7bccaeef605f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:38:16.325589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.326301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.327926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1120/2225] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:38:16 2022] DELETE /identity/v3/projects/2c845e64826a4069beb7bccaeef605f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:16.332056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:16.342657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d126344-3620-4c90-8069-b4aa92a9108a service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:16.399341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:16.409988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:16.410912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:16.411194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:16.411468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] PATH_INFO: `/v3/users/ee0177cb6dd8467f9f0afa1a54a84b8a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:16.412681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0177cb6dd8467f9f0afa1a54a84b8a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:16.414572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:16.462528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0177cb6dd8467f9f0afa1a54a84b8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.469914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0177cb6dd8467f9f0afa1a54a84b8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.481926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0177cb6dd8467f9f0afa1a54a84b8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.482685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0177cb6dd8467f9f0afa1a54a84b8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.490019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4801f977-540c-415b-9a51-6dcde83551b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0177cb6dd8467f9f0afa1a54a84b8a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.498242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1106/2226] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:38:16 2022] DELETE /identity/v3/users/ee0177cb6dd8467f9f0afa1a54a84b8a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:16.831984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:16.833666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:16.848159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba26c7-3efd-4354-8fec-2980cbaab96e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:16.915303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:16.916203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:16.916484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:16.916757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] PATH_INFO: `/v3/projects/20b714682db742acb489fd8e0c6271a8` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:16.918465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b714682db742acb489fd8e0c6271a8)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:16.920408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:16.969498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b714682db742acb489fd8e0c6271a8', 'request_id': 'req-2935ce59-e511-4bf5-ba39-453a78cb529d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.976356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b714682db742acb489fd8e0c6271a8', 'request_id': 'req-2935ce59-e511-4bf5-ba39-453a78cb529d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.982635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b714682db742acb489fd8e0c6271a8', 'request_id': 'req-2935ce59-e511-4bf5-ba39-453a78cb529d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.996004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] The token cache is being invalidate because project 20b714682db742acb489fd8e0c6271a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:38:16.996324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.996988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2935ce59-e511-4bf5-ba39-453a78cb529d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:16.998874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1121/2227] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:38:16 2022] DELETE /identity/v3/projects/20b714682db742acb489fd8e0c6271a8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:17.004071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.004369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.004649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.023387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:17.024638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:17.118740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1107/2228] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:17.128288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.128900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.129379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.149410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:17.150430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:17.160137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1122/2229] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:17.164922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.177477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57143389-f4c2-4a94-ac09-7fc9d74a08df None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.185595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.186814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.186814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.186814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.187619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:38:17.187966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.189752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.211022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1108/2230] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:38:17.212294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.222769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d070d-8f45-4dd3-883f-1dfc2ea75dbd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.228158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.229378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.229666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.230583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.231370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.233716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.261754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1123/2231] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:38:17 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:38:17.281223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.303939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81bb3-bafc-4fcb-b947-07c5976b1e35 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.372501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.373278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.373757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.374108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.374921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.376937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.383811 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:17.410534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1109/2232] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:38:17 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:38:17.414319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.425210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7bc4-9ef4-49df-8465-f716be716828 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.430280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.430964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.431247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.431521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.432299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.433943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.447763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1124/2233] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:38:17.449885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.461380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc2b9-63e7-44c2-863c-483ad8067bc1 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.473587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb50b2-32fa-4095-a4d4-d4ce4b5c30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.475230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb50b2-32fa-4095-a4d4-d4ce4b5c30ae admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.475851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb50b2-32fa-4095-a4d4-d4ce4b5c30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.476304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb50b2-32fa-4095-a4d4-d4ce4b5c30ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.477224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb50b2-32fa-4095-a4d4-d4ce4b5c30ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.479482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb50b2-32fa-4095-a4d4-d4ce4b5c30ae admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.492724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1110/2234] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:38:17.496968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.510721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dce95-b62a-4916-b47e-7657d767d78f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.516538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.517620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.518269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.518909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] PATH_INFO: `/v3/projects/24561684bf7b429fbc0326f0acc2c06e/users/fc2edcb1896447089928662ee4d22ebe/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.537637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:17.544266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24561684bf7b429fbc0326f0acc2c06e, user_id=fc2edcb1896447089928662ee4d22ebe, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.547837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.563972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1125/2235] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:38:17 2022] PUT /identity/v3/projects/24561684bf7b429fbc0326f0acc2c06e/users/fc2edcb1896447089928662ee4d22ebe/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:17.568567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c894-4c47-4baa-a104-dc7f649341ac None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.568840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c894-4c47-4baa-a104-dc7f649341ac None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.569117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c894-4c47-4baa-a104-dc7f649341ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.587839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7c82c894-4c47-4baa-a104-dc7f649341ac None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:17.589158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7c82c894-4c47-4baa-a104-dc7f649341ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:17.661363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1111/2236] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:17.671185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:17.672942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:17.731273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aadb6d-00fa-448e-b561-f615b0af1840 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:17.734953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:17.735605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:17.735924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:17.736206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:17.745991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:17.747418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:17.757464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1126/2237] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:18.606304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092e032-de40-4396-9cd8-f4cb54191396 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:18.607482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092e032-de40-4396-9cd8-f4cb54191396 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:18.607809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092e032-de40-4396-9cd8-f4cb54191396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:18.647519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5092e032-de40-4396-9cd8-f4cb54191396 None None] MFA Rules not processed for user `fc2edcb1896447089928662ee4d22ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:18.648988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5092e032-de40-4396-9cd8-f4cb54191396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:18.736367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1112/2238] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:18.747026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:18.749260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:18.856758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b636c-ced6-409f-b3bb-91380c92a663 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:18.860769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:18.861028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:18.861387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:18.861584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:18.870253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:18.871762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:18.881077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1127/2239] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:19.013627 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d9341-9499-4434-96bb-bf16811e7e0e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:19.013919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d9341-9499-4434-96bb-bf16811e7e0e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:19.014221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d9341-9499-4434-96bb-bf16811e7e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:19.034876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-062d9341-9499-4434-96bb-bf16811e7e0e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:19.036113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-062d9341-9499-4434-96bb-bf16811e7e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:19.044869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1113/2240] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:19.064588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:19.066420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:19.173408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a41e1-9581-4078-94ba-360a4cd7f109 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:19.179792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901727a-8d1a-4aaf-ba3f-269b2a38c57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:19.180457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901727a-8d1a-4aaf-ba3f-269b2a38c57d service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:19.180748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901727a-8d1a-4aaf-ba3f-269b2a38c57d service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:19.181814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901727a-8d1a-4aaf-ba3f-269b2a38c57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:19.203080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901727a-8d1a-4aaf-ba3f-269b2a38c57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:19.204872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901727a-8d1a-4aaf-ba3f-269b2a38c57d service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:19.219260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1128/2241] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:20.352226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:20.352759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:20.352759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:20.371499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] MFA Rules not processed for user `fc2edcb1896447089928662ee4d22ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:20.372741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:20.379961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1114/2242] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:24.392673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:24.393294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:24.393414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:24.419391 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:24.421675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:24.433831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1129/2243] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:24.564270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:24.595979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653d9a-dcf5-4cca-acaf-18343afd9efa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:24.609705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430554d-2fb4-4707-a179-dd1d7ebb347a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:24.610563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430554d-2fb4-4707-a179-dd1d7ebb347a service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:24.610826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430554d-2fb4-4707-a179-dd1d7ebb347a service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:24.611008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430554d-2fb4-4707-a179-dd1d7ebb347a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:24.624131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430554d-2fb4-4707-a179-dd1d7ebb347a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:24.626034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430554d-2fb4-4707-a179-dd1d7ebb347a service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:24.672413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1115/2244] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:28.446011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:28.458547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875838f-2943-439e-8646-0ac7dfb6e386 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:28.462501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:28.463158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:28.463443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:28.463739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:28.465821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:28.476827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:28.507651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:28.508308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:28.508431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:28.528538 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:28.530027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:28.539618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1116/2245] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:38:28.541388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:28.542889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:28.554301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1130/2246] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:28.557444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:28.559931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:28.581934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3ccd8-e5fb-43cc-b77e-b5853bc14654 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:28.588396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db6df7-c343-46d4-b3e0-2057f710b5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:28.589135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6df7-c343-46d4-b3e0-2057f710b5ea service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:28.589418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6df7-c343-46d4-b3e0-2057f710b5ea service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:28.589689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6df7-c343-46d4-b3e0-2057f710b5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:28.601148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db6df7-c343-46d4-b3e0-2057f710b5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:28.603072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db6df7-c343-46d4-b3e0-2057f710b5ea service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:28.615349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1117/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:30.649011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:30.650583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:30.665819 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21400ca-95c7-4f07-9d62-953da2d061e1 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:30.672855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:30.673763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:30.674047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:30.674343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] PATH_INFO: `/v3/users/dfb8fbca0f514f9186ac997b83ff700e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:30.676817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb8fbca0f514f9186ac997b83ff700e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:30.681382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:30.745230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb8fbca0f514f9186ac997b83ff700e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:30.754203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb8fbca0f514f9186ac997b83ff700e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:30.770816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb8fbca0f514f9186ac997b83ff700e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:30.771657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb8fbca0f514f9186ac997b83ff700e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:30.780872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb8fbca0f514f9186ac997b83ff700e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:30.788237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1131/2248] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:38:30 2022] DELETE /identity/v3/users/dfb8fbca0f514f9186ac997b83ff700e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:30.793541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:30.794414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:30.794909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:30.820393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:30.821768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:30.850864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:30.923915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1118/2249] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:30.932539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:30.934566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:31.026336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5cf8-a4eb-42dd-a1d0-6dedf6fc9322 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:31.031884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de4f1a-c2ea-43e4-83e6-a5b84e917c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:31.032642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de4f1a-c2ea-43e4-83e6-a5b84e917c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:31.033080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de4f1a-c2ea-43e4-83e6-a5b84e917c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:31.033433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de4f1a-c2ea-43e4-83e6-a5b84e917c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:31.045327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de4f1a-c2ea-43e4-83e6-a5b84e917c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:31.046588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de4f1a-c2ea-43e4-83e6-a5b84e917c9c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:31.068844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1132/2250] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:38:31.553984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:31.555370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:31.575279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adae9b4-28b2-4787-b7f9-f261c001c878 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:31.586939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:31.588496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:31.591151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:31.591614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] PATH_INFO: `/v3/projects/f3e0cea8289c4431b2f0cc45dd612dfd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:31.594814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e0cea8289c4431b2f0cc45dd612dfd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:31.600158 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:31.698826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e0cea8289c4431b2f0cc45dd612dfd', 'request_id': 'req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:31.711920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e0cea8289c4431b2f0cc45dd612dfd', 'request_id': 'req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:31.720115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e0cea8289c4431b2f0cc45dd612dfd', 'request_id': 'req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:31.735994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] The token cache is being invalidate because project f3e0cea8289c4431b2f0cc45dd612dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:38:31.736292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:31.736981 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bdf2e6f1-7a5b-4362-bcf4-a9273dd29a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:38:31.752284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1119/2251] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:38:31 2022] DELETE /identity/v3/projects/f3e0cea8289c4431b2f0cc45dd612dfd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:38:41.062880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:41.732034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:48.695205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:48.695775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:48.695775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:48.714498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] MFA Rules not processed for user `522718a05dfe48f291a687006be5d014`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:48.716243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:48.777548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1133/2252] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:49.401582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729c99-8a8c-4571-bc07-f8899804540b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:49.402141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729c99-8a8c-4571-bc07-f8899804540b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:49.402975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729c99-8a8c-4571-bc07-f8899804540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:49.426510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-35729c99-8a8c-4571-bc07-f8899804540b None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:49.427916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-35729c99-8a8c-4571-bc07-f8899804540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:49.526246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1120/2253] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:49.554875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:38:49.556370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:49.670793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255f2fc-75a4-43bd-88a6-0bf6fce0bbaf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:38:49.683045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a526b-513c-4b2b-99e3-1ec6dba49f29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:38:49.683783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a526b-513c-4b2b-99e3-1ec6dba49f29 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:49.684062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a526b-513c-4b2b-99e3-1ec6dba49f29 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:49.684978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a526b-513c-4b2b-99e3-1ec6dba49f29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:49.696544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a526b-513c-4b2b-99e3-1ec6dba49f29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:38:49.698706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a526b-513c-4b2b-99e3-1ec6dba49f29 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:38:49.719242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1134/2254] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:38:52.925732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:52.926352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:52.926352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:52.949564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] MFA Rules not processed for user `3fd6c3acc4ab4fd3801eb731b43fbd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:52.950900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:53.053121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1121/2255] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:38:53.820358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccdecd-d026-4295-8235-4d451ed5ce92 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:38:53.820995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccdecd-d026-4295-8235-4d451ed5ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:38:53.820995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccdecd-d026-4295-8235-4d451ed5ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:38:53.873732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e1ccdecd-d026-4295-8235-4d451ed5ce92 None None] MFA Rules not processed for user `fc2edcb1896447089928662ee4d22ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:38:53.879959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e1ccdecd-d026-4295-8235-4d451ed5ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:38:54.024945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1135/2256] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:03.029315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=50 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:04.010866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:07.517474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:07.519978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:07.618975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a62b4-c691-4d17-81e4-d550ecba7cc9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:07.626338 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:07.627249 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:07.627606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:07.627976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:07.631510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:07.650851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:07.652616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d17842-2e53-4e40-bac5-a1b33b724109 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:07.666956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1122/2257] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:09.223329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39ad24-abb8-4096-a9c7-c9be966086c5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.223947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39ad24-abb8-4096-a9c7-c9be966086c5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.224392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39ad24-abb8-4096-a9c7-c9be966086c5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.226725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1136/2258] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:39:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:39:09.235351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196ac14-aa59-4b51-8462-15f7f22346bd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.236323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196ac14-aa59-4b51-8462-15f7f22346bd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.236663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196ac14-aa59-4b51-8462-15f7f22346bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.260509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7196ac14-aa59-4b51-8462-15f7f22346bd None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:09.263815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7196ac14-aa59-4b51-8462-15f7f22346bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:09.364569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1123/2259] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:09.380836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39ad24-abb8-4096-a9c7-c9be966086c5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:09.382665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-be39ad24-abb8-4096-a9c7-c9be966086c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:09.448914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39ad24-abb8-4096-a9c7-c9be966086c5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:09.452958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe83228-dbc0-4015-a572-37f6ccdf0113 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:09.453852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe83228-dbc0-4015-a572-37f6ccdf0113 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.454354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe83228-dbc0-4015-a572-37f6ccdf0113 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.454820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe83228-dbc0-4015-a572-37f6ccdf0113 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.467290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe83228-dbc0-4015-a572-37f6ccdf0113 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:09.469234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe83228-dbc0-4015-a572-37f6ccdf0113 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:09.486744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1137/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:09.559307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e0e6-2062-4526-a386-20bd6a4c7eff None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.559619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e0e6-2062-4526-a386-20bd6a4c7eff None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.559899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e0e6-2062-4526-a386-20bd6a4c7eff None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.561310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1124/2261] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:39:09.566994 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d9e5-a56b-4526-a76a-08b628cfa0b1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.567285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d9e5-a56b-4526-a76a-08b628cfa0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.567576 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d9e5-a56b-4526-a76a-08b628cfa0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.586278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5664d9e5-a56b-4526-a76a-08b628cfa0b1 None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:09.587785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5664d9e5-a56b-4526-a76a-08b628cfa0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:09.642626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1138/2262] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:09.657840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e0e6-2062-4526-a386-20bd6a4c7eff None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:09.660377 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3613e0e6-2062-4526-a386-20bd6a4c7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:09.673909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e0e6-2062-4526-a386-20bd6a4c7eff None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:09.677735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fa6e0-22ad-40c1-87c5-fcb90a5bdf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:09.678400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa6e0-22ad-40c1-87c5-fcb90a5bdf36 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.678657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa6e0-22ad-40c1-87c5-fcb90a5bdf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.678926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fa6e0-22ad-40c1-87c5-fcb90a5bdf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.687117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fa6e0-22ad-40c1-87c5-fcb90a5bdf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:09.688555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fa6e0-22ad-40c1-87c5-fcb90a5bdf36 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:09.696639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1125/2263] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:09.780680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12d78e-471f-4b58-998b-e5c9f27c5188 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.780972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12d78e-471f-4b58-998b-e5c9f27c5188 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.781266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12d78e-471f-4b58-998b-e5c9f27c5188 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.782674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1139/2264] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:39:09.787858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a5b6-0ae3-46df-a9c7-f25493a16df4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.788144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a5b6-0ae3-46df-a9c7-f25493a16df4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.788418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a5b6-0ae3-46df-a9c7-f25493a16df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.807831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b732a5b6-0ae3-46df-a9c7-f25493a16df4 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:09.809024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b732a5b6-0ae3-46df-a9c7-f25493a16df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:09.818402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1126/2265] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:09.828790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12d78e-471f-4b58-998b-e5c9f27c5188 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:09.840860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12d78e-471f-4b58-998b-e5c9f27c5188 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:09.844643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:09.845288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:09.845574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:09.845880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:09.859339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:09.860822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:09.872092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1140/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:17.218285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1250d1-22f8-4232-a275-ef04583245c3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:17.219439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1250d1-22f8-4232-a275-ef04583245c3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:17.220251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1250d1-22f8-4232-a275-ef04583245c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:17.248062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ef1250d1-22f8-4232-a275-ef04583245c3 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:17.249302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ef1250d1-22f8-4232-a275-ef04583245c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:17.256923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1127/2267] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:17.272905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:17.287363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66a689-26c7-4ad2-b9f8-941adce182ec service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:17.300129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:17.301499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:17.302093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:17.303342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:17.316846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:17.318927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:17.326739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498c9c7-8ab2-4994-b220-de8f1d91afd6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:17.327025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498c9c7-8ab2-4994-b220-de8f1d91afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:17.327298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498c9c7-8ab2-4994-b220-de8f1d91afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:17.336137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1141/2268] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:39:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:39:17.353549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3498c9c7-8ab2-4994-b220-de8f1d91afd6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:17.358313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3498c9c7-8ab2-4994-b220-de8f1d91afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:17.447823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:17.465884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1128/2269] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:39:17.491689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:17.493654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:17.525927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec36e-ac2a-4aa4-89a0-64558d63c669 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:17.533279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:17.534274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:17.534801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:17.535270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:17.566341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:17.567982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:17.582964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1142/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:18.924476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49afc11-08b9-4277-8c39-82cbbf43477e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:18.925019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49afc11-08b9-4277-8c39-82cbbf43477e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:18.925289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49afc11-08b9-4277-8c39-82cbbf43477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:18.950715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b49afc11-08b9-4277-8c39-82cbbf43477e None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:18.952318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b49afc11-08b9-4277-8c39-82cbbf43477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:18.986604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1129/2271] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:19.000993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:19.014020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57670f26-9a6f-429d-8412-c0098c9e0020 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:19.020532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:19.021193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:19.021475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:19.021749 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:19.030838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:19.032611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:19.042258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1143/2272] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:39:28.943540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:29.038087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=73 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:35.643447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42fd0-2d8b-4b0b-8f2c-b595f626fde4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:35.644037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42fd0-2d8b-4b0b-8f2c-b595f626fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:35.644037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42fd0-2d8b-4b0b-8f2c-b595f626fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:35.667197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-03d42fd0-2d8b-4b0b-8f2c-b595f626fde4 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:35.668445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-03d42fd0-2d8b-4b0b-8f2c-b595f626fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:35.675790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1130/2273] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 20 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:35.688493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:35.700080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607b1d5-6dcc-4701-9bc7-5cad039fac7f service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:35.705457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:35.706199 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:35.706552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:35.706896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:35.716556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:35.718293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:35.727288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1144/2274] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:39:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:39:36.410277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97badee-a89d-484b-8e2b-386285c14e80 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:36.411004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97badee-a89d-484b-8e2b-386285c14e80 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:36.411300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97badee-a89d-484b-8e2b-386285c14e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:36.434299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d97badee-a89d-484b-8e2b-386285c14e80 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:36.435556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d97badee-a89d-484b-8e2b-386285c14e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:36.445472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1131/2275] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:36.465584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:36.468924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:36.494788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48d632-46fe-4d15-894f-fe371279b830 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:36.502196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:36.503335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:36.503880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:36.504460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:36.519135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:36.521705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:36.539913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1145/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:37.650881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15c25-e2a3-4cc9-844d-cf65489bb4c5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:37.651360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15c25-e2a3-4cc9-844d-cf65489bb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:37.651566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15c25-e2a3-4cc9-844d-cf65489bb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:37.704485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-08b15c25-e2a3-4cc9-844d-cf65489bb4c5 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:37.707506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-08b15c25-e2a3-4cc9-844d-cf65489bb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:37.720304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1132/2277] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 20 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:37.735539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:37.755087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37ab7-f47d-4daa-bd55-1db6aa3c0390 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:37.763620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f7fba-48d6-4abb-978a-6a8750e01e67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:37.764684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7fba-48d6-4abb-978a-6a8750e01e67 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:37.765174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7fba-48d6-4abb-978a-6a8750e01e67 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:37.765908 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7fba-48d6-4abb-978a-6a8750e01e67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:37.778237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f7fba-48d6-4abb-978a-6a8750e01e67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:37.781184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f7fba-48d6-4abb-978a-6a8750e01e67 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:37.792864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1146/2278] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:39:38.192025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eed468-15f3-427a-a026-c8b95eac2f11 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:38.192504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eed468-15f3-427a-a026-c8b95eac2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:38.192982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eed468-15f3-427a-a026-c8b95eac2f11 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:38.194985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1133/2279] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:39:38.206709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:38.207435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:38.207963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:38.233654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] MFA Rules not processed for user `4ad02dfcd1184ef690f171ac4410381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:38.266859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:38.283136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1147/2280] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:39:38.306294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eed468-15f3-427a-a026-c8b95eac2f11 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:38.310366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:38.312186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:38.314742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f9eed468-15f3-427a-a026-c8b95eac2f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:38.329837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87084c0f-d4ff-4da7-8a18-8c02dd30d69e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:38.335662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:38.336532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:38.337030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:38.337473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:38.347685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:38.349709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:38.361469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eed468-15f3-427a-a026-c8b95eac2f11 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:38.362319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1148/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:39:38.370659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:38.372596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:38.373161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:38.373620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] PATH_INFO: `/v3/users/fc2edcb1896447089928662ee4d22ebe` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:38.375793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2edcb1896447089928662ee4d22ebe)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:38.379349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:38.444443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2edcb1896447089928662ee4d22ebe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.452911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2edcb1896447089928662ee4d22ebe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.466184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2edcb1896447089928662ee4d22ebe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.466917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2edcb1896447089928662ee4d22ebe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.474448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-798d8b30-910d-4af1-9085-eb140a70bab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2edcb1896447089928662ee4d22ebe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.481664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1134/2282] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:39:38 2022] DELETE /identity/v3/users/fc2edcb1896447089928662ee4d22ebe => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:39:38.671390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:38.687886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e3b8b-af0a-482b-80cb-f706863acabc service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:38.806363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:38.810668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:38.811854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:38.813505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] PATH_INFO: `/v3/projects/24561684bf7b429fbc0326f0acc2c06e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:38.816954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24561684bf7b429fbc0326f0acc2c06e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:38.820198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:38.915531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24561684bf7b429fbc0326f0acc2c06e', 'request_id': 'req-692a6a52-9647-4097-b9cd-2401b6d3ad28'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.925400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24561684bf7b429fbc0326f0acc2c06e', 'request_id': 'req-692a6a52-9647-4097-b9cd-2401b6d3ad28'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.933398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24561684bf7b429fbc0326f0acc2c06e', 'request_id': 'req-692a6a52-9647-4097-b9cd-2401b6d3ad28'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.947099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] The token cache is being invalidate because project 24561684bf7b429fbc0326f0acc2c06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:39:38.947390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.948107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-692a6a52-9647-4097-b9cd-2401b6d3ad28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:38.949905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1149/2283] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:39:38 2022] DELETE /identity/v3/projects/24561684bf7b429fbc0326f0acc2c06e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:39:38.954879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:38.955396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:38.955523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:38.975143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:38.976395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:39.063901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1135/2284] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:39.073510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197695-687f-4111-8175-98ea5a827500 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.073798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197695-687f-4111-8175-98ea5a827500 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.074076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197695-687f-4111-8175-98ea5a827500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.097786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b2197695-687f-4111-8175-98ea5a827500 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:39.099788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b2197695-687f-4111-8175-98ea5a827500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:39.110014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1150/2285] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:39.114980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.126064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9c5bd-01fe-42c8-bedf-21b8a63db976 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.132438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.133123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.133403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.133704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.135566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:39:39.135906 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.138352 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.154346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1136/2286] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:39:39.158119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2197695-687f-4111-8175-98ea5a827500 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.168882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2197695-687f-4111-8175-98ea5a827500 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.173918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.174647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.174933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.175213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.175950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.177893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.209106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1151/2287] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:39:39 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:39:39.210325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.221723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da230a8-cdb1-4560-a9ab-5c29f0be4c14 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.261637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:39.284762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.285468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.285756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.286039 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.286755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.288920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.325177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1137/2288] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:39:39 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:39:39.330280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.337862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:39.344016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c7ff-0654-4b77-8e5d-0dac4385ba51 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.349811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.350554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.350911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.351258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.352148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.354387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.368724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1152/2289] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:39:39.370460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.381800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b89ff-bd4c-4045-9933-786c758aa07f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.387393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025250-2669-4b33-9871-13552f48aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.388353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025250-2669-4b33-9871-13552f48aba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.388873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025250-2669-4b33-9871-13552f48aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.389380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025250-2669-4b33-9871-13552f48aba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.390439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025250-2669-4b33-9871-13552f48aba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.392617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025250-2669-4b33-9871-13552f48aba2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.419131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1138/2290] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:39:39.420826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.434817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac959e7-2f7a-49ce-8033-7394918642f4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.440034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.441152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.441441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.441812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] PATH_INFO: `/v3/projects/abfd2c0e78574a539d470b4f5507887b/users/3d631f67caf54d1c8411e282fcc7b633/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.461100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfd2c0e78574a539d470b4f5507887b, user_id=3d631f67caf54d1c8411e282fcc7b633, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.465641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.485196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1153/2291] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:39:39 2022] PUT /identity/v3/projects/abfd2c0e78574a539d470b4f5507887b/users/3d631f67caf54d1c8411e282fcc7b633/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:39:39.493005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967222-bce3-463d-bba4-408a61870ded None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.493405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967222-bce3-463d-bba4-408a61870ded None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.493797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967222-bce3-463d-bba4-408a61870ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.527852 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bc967222-bce3-463d-bba4-408a61870ded None None] MFA Rules not processed for user `3d631f67caf54d1c8411e282fcc7b633`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:39.529176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc967222-bce3-463d-bba4-408a61870ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:39.595846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1139/2292] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:39.606483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:39.608256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:39.673311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e182-398a-41be-a78f-673f99eba629 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:39.677090 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:39.677744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:39.678029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:39.678302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:39.687426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:39.689056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:39.699313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1154/2293] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:40.558069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b488b-a8f5-4338-8a8a-b91353d1fa27 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:40.558626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b488b-a8f5-4338-8a8a-b91353d1fa27 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:40.558803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b488b-a8f5-4338-8a8a-b91353d1fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:40.578545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a14b488b-a8f5-4338-8a8a-b91353d1fa27 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:40.580141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a14b488b-a8f5-4338-8a8a-b91353d1fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:40.642404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1140/2294] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:40.657113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:40.659204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:40.738102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d3aad-a3e1-4a6d-af61-f7e655ffcceb service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:40.744664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:40.745930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:40.745930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:40.746104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:40.755403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:40.757150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:40.769976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1155/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:44.778706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:44.779179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:44.779375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:44.799059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:44.800436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:44.813766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1141/2296] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:44.834693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:44.836926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:44.861609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea8e9-c43b-4f90-93e7-76850f58592a service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:44.869409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bba38-b63f-4b9a-8491-e9c82a2df5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:44.870501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bba38-b63f-4b9a-8491-e9c82a2df5a8 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:44.870858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bba38-b63f-4b9a-8491-e9c82a2df5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:44.871213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bba38-b63f-4b9a-8491-e9c82a2df5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:44.884962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bba38-b63f-4b9a-8491-e9c82a2df5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:44.888058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bba38-b63f-4b9a-8491-e9c82a2df5a8 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:44.904726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1156/2297] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:49.980778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:49.990984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e50d21-c844-4c00-8f58-42256ce5de35 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:49.995964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:49.996836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:49.997121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:49.997397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] PATH_INFO: `/v3/users/3d631f67caf54d1c8411e282fcc7b633` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:49.998667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d631f67caf54d1c8411e282fcc7b633)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:50.000715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:50.001030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:50.001455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:50.001592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:50.020497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:50.021699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:50.030729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1157/2298] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 20 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:39:50.043644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:50.045794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:50.053675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d631f67caf54d1c8411e282fcc7b633'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.058451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe43de-3d38-4bed-86d7-dc8b051db47d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:50.061246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d631f67caf54d1c8411e282fcc7b633'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.064119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53daeb-ba62-4e26-acae-538e7e14b743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:50.064980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53daeb-ba62-4e26-acae-538e7e14b743 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:50.065266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53daeb-ba62-4e26-acae-538e7e14b743 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:50.065540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53daeb-ba62-4e26-acae-538e7e14b743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:50.074797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d631f67caf54d1c8411e282fcc7b633'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.074957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53daeb-ba62-4e26-acae-538e7e14b743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:50.075479 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d631f67caf54d1c8411e282fcc7b633'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.076533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53daeb-ba62-4e26-acae-538e7e14b743 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:50.087100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1158/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:50.089038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d631f67caf54d1c8411e282fcc7b633'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.095400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1142/2300] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:39:49 2022] DELETE /identity/v3/users/3d631f67caf54d1c8411e282fcc7b633 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:39:50.099928 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:50.100415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:50.100853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:50.119316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:50.120563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:50.138608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:50.182348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1159/2301] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:39:50.192398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:50.193898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:50.251907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759390c-572f-4598-bf5f-9fe653588be8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:50.255563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01b167-f1d1-4d14-9145-786bbc64c6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:50.256239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01b167-f1d1-4d14-9145-786bbc64c6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:50.256516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01b167-f1d1-4d14-9145-786bbc64c6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:50.256790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01b167-f1d1-4d14-9145-786bbc64c6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:50.267159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01b167-f1d1-4d14-9145-786bbc64c6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:50.268537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01b167-f1d1-4d14-9145-786bbc64c6f7 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:50.278769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1143/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:39:50.585540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:39:50.591865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:50.607010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aa1e3-b99d-4498-930c-b2fb15e93fea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:39:50.623916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:39:50.625093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:50.625263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:50.625793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] PATH_INFO: `/v3/projects/abfd2c0e78574a539d470b4f5507887b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:50.627187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfd2c0e78574a539d470b4f5507887b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:39:50.629148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:39:50.690269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfd2c0e78574a539d470b4f5507887b', 'request_id': 'req-7a290a2b-6539-497b-ace2-72274998473f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.701165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfd2c0e78574a539d470b4f5507887b', 'request_id': 'req-7a290a2b-6539-497b-ace2-72274998473f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.708140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfd2c0e78574a539d470b4f5507887b', 'request_id': 'req-7a290a2b-6539-497b-ace2-72274998473f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.721564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] The token cache is being invalidate because project abfd2c0e78574a539d470b4f5507887b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:39:50.721890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.722604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:39:50.724801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1160/2303] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:39:50 2022] DELETE /identity/v3/projects/abfd2c0e78574a539d470b4f5507887b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:39:52.425924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:39:52.426493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:39:52.426493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:39:52.445419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] MFA Rules not processed for user `2c6ad0ad11944b81accd2f70a322d176`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:39:52.446671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:39:52.502390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1144/2304] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:00.717385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:02.495711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:21.660117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:21.661918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:21.737718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290a2b-6539-497b-ace2-72274998473f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:21.742637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:21.743618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:21.743915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:21.744170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] PATH_INFO: `/v3/users/3fd6c3acc4ab4fd3801eb731b43fbd9c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:21.745445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd6c3acc4ab4fd3801eb731b43fbd9c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:21.747411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:21.807806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd6c3acc4ab4fd3801eb731b43fbd9c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:21.815445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd6c3acc4ab4fd3801eb731b43fbd9c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:21.828639 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd6c3acc4ab4fd3801eb731b43fbd9c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:21.829365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd6c3acc4ab4fd3801eb731b43fbd9c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:21.836337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9664895f-50b6-477a-a1cc-05847aa97c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd6c3acc4ab4fd3801eb731b43fbd9c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:21.842253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1161/2305] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:40:21 2022] DELETE /identity/v3/users/3fd6c3acc4ab4fd3801eb731b43fbd9c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:40:22.020874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.032619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0f77-ad66-45ce-8c26-614fcde0e387 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.096597 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.097363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.097645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.097911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] PATH_INFO: `/v3/projects/5125c4badf3d4c6f979dfeeac3a43a38` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.099092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5125c4badf3d4c6f979dfeeac3a43a38)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.101087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.151282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5125c4badf3d4c6f979dfeeac3a43a38', 'request_id': 'req-6928d3bc-2dfb-4287-b3ad-c755a03c3198'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:22.160414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5125c4badf3d4c6f979dfeeac3a43a38', 'request_id': 'req-6928d3bc-2dfb-4287-b3ad-c755a03c3198'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:22.166974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5125c4badf3d4c6f979dfeeac3a43a38', 'request_id': 'req-6928d3bc-2dfb-4287-b3ad-c755a03c3198'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:22.180248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] The token cache is being invalidate because project 5125c4badf3d4c6f979dfeeac3a43a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:40:22.180529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:22.181188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6928d3bc-2dfb-4287-b3ad-c755a03c3198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:22.182721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1145/2306] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:40:22 2022] DELETE /identity/v3/projects/5125c4badf3d4c6f979dfeeac3a43a38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:22.187660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.188065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.188354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.207384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:22.208625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:22.276974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1162/2307] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:22.285320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.285611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.285891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.306949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:22.308200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:22.321806 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1146/2308] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:22.323009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.332775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9fec0-14a6-4774-9d81-5d03c2987d77 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.337557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.338284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.338566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.338842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.339620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:40:22.339977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.341627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.355978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1163/2309] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:40:22.359493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.369853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632aad-df33-44f6-8b3b-392db4e69a91 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.374704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.375376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.375667 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.375993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.376705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.379013 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.423113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1147/2310] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:40:22 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:40:22.427695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.440318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4e5b1-5ceb-4dce-ba13-5f4bca6495a3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.444103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:22.500736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.501417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.501704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.502017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.502709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.504669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.524845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1164/2311] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:40:22 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:40:22.528938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.539648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ca61-5160-47e6-bbdc-a8645b7cf757 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.544552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.545223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.545506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.545780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.546510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.548201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.559435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1148/2312] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:40:22.563934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.574224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e652136-7c9c-4670-b71f-2dbccec6f931 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.578875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f843ca-4ca2-448c-8a39-b9827d01c8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.579535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f843ca-4ca2-448c-8a39-b9827d01c8ee admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.579879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f843ca-4ca2-448c-8a39-b9827d01c8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.580159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f843ca-4ca2-448c-8a39-b9827d01c8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.580889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f843ca-4ca2-448c-8a39-b9827d01c8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.582478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f843ca-4ca2-448c-8a39-b9827d01c8ee admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.593159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1165/2313] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:40:22.597047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.607982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ecc4-4852-486a-9685-9c6d4c1909d0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.612664 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.613543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.613828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.614104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] PATH_INFO: `/v3/projects/70bd35837c8749338c30a9875091c5df/users/4484b6340cf54321b30a415134230425/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.628541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bd35837c8749338c30a9875091c5df, user_id=4484b6340cf54321b30a415134230425, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.631240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.644035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1149/2314] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:40:22 2022] PUT /identity/v3/projects/70bd35837c8749338c30a9875091c5df/users/4484b6340cf54321b30a415134230425/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:22.655354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.655653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.655998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.682614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] MFA Rules not processed for user `4484b6340cf54321b30a415134230425`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:22.683869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:22.747483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1166/2315] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:22.759062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:22.760821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:22.793612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:22.832400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47e4f-73c2-4a19-9bcd-281cc463c31e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:22.837196 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92858b-b5ee-4df2-9314-e85d2ce9ac59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:22.838053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92858b-b5ee-4df2-9314-e85d2ce9ac59 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:22.838261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92858b-b5ee-4df2-9314-e85d2ce9ac59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:22.838532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92858b-b5ee-4df2-9314-e85d2ce9ac59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:22.849278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92858b-b5ee-4df2-9314-e85d2ce9ac59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:22.850890 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92858b-b5ee-4df2-9314-e85d2ce9ac59 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:22.865123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1150/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:40:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:40:27.896976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:27.962163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f016f1a-806a-47e3-af78-82e755485503 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:27.966833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:27.967742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:27.968028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:27.968329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] PATH_INFO: `/v3/users/4484b6340cf54321b30a415134230425` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:27.969608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4484b6340cf54321b30a415134230425)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:27.971559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:27.989781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:28.032244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4484b6340cf54321b30a415134230425'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.045207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4484b6340cf54321b30a415134230425'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.058287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4484b6340cf54321b30a415134230425'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.058926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4484b6340cf54321b30a415134230425'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.065929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4484b6340cf54321b30a415134230425'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.072453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1167/2317] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:40:27 2022] DELETE /identity/v3/users/4484b6340cf54321b30a415134230425 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:28.077059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:28.077534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:28.077666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:28.095493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:28.096761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:28.161564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1151/2318] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:40:28.168672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:28.170134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:28.240439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff427-fab6-45c1-83e2-5095d67ccd8f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:28.246711 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc125df-910d-4963-be6d-0f9ba8c36a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:28.247886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc125df-910d-4963-be6d-0f9ba8c36a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:28.248522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc125df-910d-4963-be6d-0f9ba8c36a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:28.248808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc125df-910d-4963-be6d-0f9ba8c36a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:28.259887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc125df-910d-4963-be6d-0f9ba8c36a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:28.261475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc125df-910d-4963-be6d-0f9ba8c36a0f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:28.275939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1168/2319] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:40:28.568840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:28.571576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:28.584822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef707-8b5c-47d6-b356-f021b5b6257a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:28.592406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:28.593322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:28.593732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:28.593860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] PATH_INFO: `/v3/projects/70bd35837c8749338c30a9875091c5df` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:28.595127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bd35837c8749338c30a9875091c5df)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:28.597320 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:28.652445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bd35837c8749338c30a9875091c5df', 'request_id': 'req-8d2e15ae-407b-42ef-9955-ad86be3107e6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.660961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bd35837c8749338c30a9875091c5df', 'request_id': 'req-8d2e15ae-407b-42ef-9955-ad86be3107e6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.668118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bd35837c8749338c30a9875091c5df', 'request_id': 'req-8d2e15ae-407b-42ef-9955-ad86be3107e6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.680438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] The token cache is being invalidate because project 70bd35837c8749338c30a9875091c5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:40:28.680729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.681398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8d2e15ae-407b-42ef-9955-ad86be3107e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:28.682960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1152/2320] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:40:28 2022] DELETE /identity/v3/projects/70bd35837c8749338c30a9875091c5df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:30.058447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51512-54b7-4248-9491-c3a9fd3ad027 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:30.058957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51512-54b7-4248-9491-c3a9fd3ad027 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:30.059056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51512-54b7-4248-9491-c3a9fd3ad027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:30.076838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0ca51512-54b7-4248-9491-c3a9fd3ad027 None None] MFA Rules not processed for user `3e9653f2408549da853449559ec820b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:30.078050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0ca51512-54b7-4248-9491-c3a9fd3ad027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:30.135326 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1169/2321] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:40:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:31.009409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:31.009930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:31.010409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:31.029295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] MFA Rules not processed for user `522718a05dfe48f291a687006be5d014`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:31.030533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:31.081089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:31.095881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1153/2322] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:40:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:40.127840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=9,keystone:SELECT=71,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:41.092869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:41.714783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:41.715230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:41.715353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:41.734251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:40:41.735495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:41.795991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1170/2323] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 20 09:40:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:40:41.849094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:41.850663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:41.926037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530ca9b-c264-4151-a82d-4abad510d880 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:41.931121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:41.931819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:41.932079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:41.932357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:41.941868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:41.943201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:41.953044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1154/2324] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:40:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:40:49.964026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:49.965524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:50.033803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a734-5d2f-4d47-ada5-6f8087e651e0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:50.038603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:50.039496 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:50.039815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:50.040096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] PATH_INFO: `/v3/users/07f3f6934b3b4e759a25562064a5e4f7` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:50.041309 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f3f6934b3b4e759a25562064a5e4f7)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:50.043248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:50.096614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f3f6934b3b4e759a25562064a5e4f7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.104734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f3f6934b3b4e759a25562064a5e4f7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.118229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f3f6934b3b4e759a25562064a5e4f7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.118916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f3f6934b3b4e759a25562064a5e4f7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.126449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f3f6934b3b4e759a25562064a5e4f7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.133168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1171/2325] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:40:49 2022] DELETE /identity/v3/users/07f3f6934b3b4e759a25562064a5e4f7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:50.308081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:50.319302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694fc87-d0a9-4fbb-913a-a0b02b5e38eb service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:50.382394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:50.383173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:50.383537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:50.383864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] PATH_INFO: `/v3/projects/b52419bce204499899da61fee483a3a3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:50.385073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52419bce204499899da61fee483a3a3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:50.386983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:50.434096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52419bce204499899da61fee483a3a3', 'request_id': 'req-797eb33d-5d24-40a4-92ac-f88da91f1fa4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.441623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52419bce204499899da61fee483a3a3', 'request_id': 'req-797eb33d-5d24-40a4-92ac-f88da91f1fa4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.447814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52419bce204499899da61fee483a3a3', 'request_id': 'req-797eb33d-5d24-40a4-92ac-f88da91f1fa4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.458863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] The token cache is being invalidate because project b52419bce204499899da61fee483a3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:40:50.459184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.459868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.461407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1155/2326] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:40:50 2022] DELETE /identity/v3/projects/b52419bce204499899da61fee483a3a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:50.465453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:50.466848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:50.479893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00161ce-ea79-47cd-a914-4ec09f0b27cf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:50.500024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:50.538220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:50.539104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:50.539383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:50.539666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] PATH_INFO: `/v3/users/3f32dbffd0de4970bc8d77048a9b472f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:50.540895 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f32dbffd0de4970bc8d77048a9b472f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:50.542835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:50.589394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f32dbffd0de4970bc8d77048a9b472f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.596776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f32dbffd0de4970bc8d77048a9b472f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.608857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f32dbffd0de4970bc8d77048a9b472f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.609377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f32dbffd0de4970bc8d77048a9b472f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.616862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e35f1a2c-76cd-434d-9c35-da7af1f75f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f32dbffd0de4970bc8d77048a9b472f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.622835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1172/2327] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:40:50 2022] DELETE /identity/v3/users/3f32dbffd0de4970bc8d77048a9b472f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:40:50.796395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:40:50.797969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:40:50.811831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eb33d-5d24-40a4-92ac-f88da91f1fa4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:40:50.831808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:50.872856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:40:50.873731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:40:50.874005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:40:50.874274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] PATH_INFO: `/v3/projects/56ef63905021419bad84544eed157f0f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:40:50.875454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ef63905021419bad84544eed157f0f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:40:50.877409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:40:50.924937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ef63905021419bad84544eed157f0f', 'request_id': 'req-404020f4-5d89-42f5-9c8e-5895fe953879'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.932775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ef63905021419bad84544eed157f0f', 'request_id': 'req-404020f4-5d89-42f5-9c8e-5895fe953879'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.938367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ef63905021419bad84544eed157f0f', 'request_id': 'req-404020f4-5d89-42f5-9c8e-5895fe953879'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.949656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] The token cache is being invalidate because project 56ef63905021419bad84544eed157f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:40:50.949943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.950594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-404020f4-5d89-42f5-9c8e-5895fe953879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:40:50.952179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1156/2328] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:40:50 2022] DELETE /identity/v3/projects/56ef63905021419bad84544eed157f0f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:00.619273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:00.947057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:01.740415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:01.740913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:01.741048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:01.758165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] MFA Rules not processed for user `4247e1dc34ef44c5b933e105d170911d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:01.759367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:01.816620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1173/2329] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:06.655738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:06.656299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:06.656431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:06.674560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] MFA Rules not processed for user `2c6ad0ad11944b81accd2f70a322d176`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:06.675791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:06.730509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1157/2330] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:08.703472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:08.704944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:08.764767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec34b-712f-4c77-a4c8-2a7bcb22960e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:08.768804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:08.769467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:08.769745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:08.770143 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:08.772583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:08.862172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:08.864171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:08.877232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1174/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:08.899605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:08.909588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b44a6-626e-4e38-b7a7-367b8486c109 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:08.914022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:08.915054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:08.915551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:08.916024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:08.919147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:08.945632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:08.947294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:08.964607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1158/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:18.871672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=79 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:18.956067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=31 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:20.112525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:20.113957 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:20.128092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299889f7-d73e-43fd-b0ec-3bcbeb41981f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:20.134309 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:20.134962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:20.135249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:20.135525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:20.137354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:20.149068 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:20.150649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:20.159782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1175/2333] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:29.142427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:29.153860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eff38-61d3-43e7-aab6-c0f951a8b05c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:29.159381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:29.160057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:29.160437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:29.161218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:29.162984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:29.221615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:29.223738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:29.232943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1159/2334] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:30.157173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:32.405568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:32.407026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:32.421838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a97b2-d5ff-4e25-96bd-7277db2fcc1a service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:32.428156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:32.428809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:32.429097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:32.429377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:32.431350 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:32.492458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:32.494099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:32.503430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1176/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:33.952089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:33.953511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:33.965215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c57a3d-840e-48e5-9160-56ef8d525ddc service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:33.968968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:33.969612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:33.969899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:33.970178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:33.971960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:34.036630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:34.038021 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:34.047581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1160/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:37.525958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:37.527672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:37.543762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabd8dc-0490-4929-b88d-df915345dab7 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:37.552706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:37.558482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:37.558482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:37.558482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] PATH_INFO: `/v3/users/522718a05dfe48f291a687006be5d014` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:37.558783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=522718a05dfe48f291a687006be5d014)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:37.561979 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:37.619930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522718a05dfe48f291a687006be5d014'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.628193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522718a05dfe48f291a687006be5d014'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.641414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522718a05dfe48f291a687006be5d014'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.642109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522718a05dfe48f291a687006be5d014'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.649574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6fbfd4be-46c7-4fb6-aac0-13e971812b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522718a05dfe48f291a687006be5d014'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.655669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1177/2337] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:41:37 2022] DELETE /identity/v3/users/522718a05dfe48f291a687006be5d014 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:37.836045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:37.849809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b160-3a5e-4436-b8c0-aad0d1e8480c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:37.917764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:37.918949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:37.919393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:37.919787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] PATH_INFO: `/v3/projects/c9aa7b79d697427e8a6b3edcb2ccbd61` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:37.921285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9aa7b79d697427e8a6b3edcb2ccbd61)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:37.923169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:37.964719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:37.976072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9aa7b79d697427e8a6b3edcb2ccbd61', 'request_id': 'req-063f062c-8f28-442b-a739-37e6cd0ee7a7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.984625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9aa7b79d697427e8a6b3edcb2ccbd61', 'request_id': 'req-063f062c-8f28-442b-a739-37e6cd0ee7a7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:37.990742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9aa7b79d697427e8a6b3edcb2ccbd61', 'request_id': 'req-063f062c-8f28-442b-a739-37e6cd0ee7a7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:38.002112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] The token cache is being invalidate because project c9aa7b79d697427e8a6b3edcb2ccbd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:41:38.002403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:38.003148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-063f062c-8f28-442b-a739-37e6cd0ee7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:38.005164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1161/2338] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:41:37 2022] DELETE /identity/v3/projects/c9aa7b79d697427e8a6b3edcb2ccbd61 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:38.010219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.010510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.010791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.030037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:38.031238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:38.091277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1178/2339] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:38.099432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.099673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.100035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.118380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:38.119643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:38.128499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1162/2340] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:38.133373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.143412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bead9-906c-4114-b888-d223da42c75e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.149375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.150432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.150820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.151253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.152450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:41:38.152788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.155104 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.162732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:38.168805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1179/2341] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:41:38.173329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.183435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251c64b-ad63-43ac-9456-5e325f910549 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.188446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.189097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.189380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.189656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.190343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.192822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.220157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1163/2342] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:38.227049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.237840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9967e-fa6d-4f06-9efe-5673a40d1569 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.306277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.306880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.307167 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.307448 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.308176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.310119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.334608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1180/2343] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:41:38.338983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.349544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39124f5f-e6c3-4da9-90ad-dea777c988f9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.354256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.354922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.355210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.355518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.356346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.358171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.369878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1164/2344] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:38.373861 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.384831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b4e9-f610-42f2-b6d0-40c9f9b1bd8e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.389594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c45f2-0765-4d37-aa64-87fc051a6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.390556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c45f2-0765-4d37-aa64-87fc051a6246 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.390824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c45f2-0765-4d37-aa64-87fc051a6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.391099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c45f2-0765-4d37-aa64-87fc051a6246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.391941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c45f2-0765-4d37-aa64-87fc051a6246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.393547 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c45f2-0765-4d37-aa64-87fc051a6246 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.405444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1181/2345] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:38.409822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.420007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92092cb2-5bc3-4c62-a5f7-c983d9d4476e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.424911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.426303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.426665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.426957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] PATH_INFO: `/v3/projects/616057d23bff431f8837ecea5c2aa82f/users/6a2f9231f5e0489d8061c3b5e96a49a3/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.441828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=616057d23bff431f8837ecea5c2aa82f, user_id=6a2f9231f5e0489d8061c3b5e96a49a3, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.445287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.459230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1165/2346] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:38 2022] PUT /identity/v3/projects/616057d23bff431f8837ecea5c2aa82f/users/6a2f9231f5e0489d8061c3b5e96a49a3/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:38.470879 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.471169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.471478 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.505809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] MFA Rules not processed for user `6a2f9231f5e0489d8061c3b5e96a49a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:38.507221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:38.577304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1182/2347] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:38.581919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.650162 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cae7b-b631-4069-90ac-e523d28e32ac admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.656095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.657379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.657679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.657966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.658671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.661153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.687801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1166/2348] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:38.692024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.703663 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa524d27-c497-42c3-a33d-662e3b6ec787 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.765238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.766234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.766762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.767148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.768108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.770115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.779781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:38.792550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1183/2349] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:41:38 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:38.796686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.807614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a2b3-05f5-48d0-b500-31498d791637 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.812587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.813373 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.813530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.813796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.814552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.816173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.828118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1167/2350] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:38.832620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.845834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa71026-03c8-4a04-b701-95d62020e23e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.850541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.851423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.851712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.852020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] PATH_INFO: `/v3/projects/e1b63dbd1294485286a25a01dcc74e90/users/3cfe9ca3b3a248b7b27e094a9ae778d4/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.868375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b63dbd1294485286a25a01dcc74e90, user_id=3cfe9ca3b3a248b7b27e094a9ae778d4, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.871041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.892081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1184/2351] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:38 2022] PUT /identity/v3/projects/e1b63dbd1294485286a25a01dcc74e90/users/3cfe9ca3b3a248b7b27e094a9ae778d4/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:38.896200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.906944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b31fd-c18e-4589-acbe-9f859ab0644d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:38.936214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:38.965546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5efa-f348-474b-8ad6-28ad376edb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:38.966221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5efa-f348-474b-8ad6-28ad376edb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:38.966506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5efa-f348-474b-8ad6-28ad376edb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:38.966790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5efa-f348-474b-8ad6-28ad376edb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:38.967521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5efa-f348-474b-8ad6-28ad376edb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:38.969148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5efa-f348-474b-8ad6-28ad376edb30 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:38.979120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1168/2352] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:38.983323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:38.994089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1f06b-4b1e-4697-b5e4-7777eb20ac65 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:39.003012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:39.004461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:39.004744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:39.005020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] PATH_INFO: `/v3/projects/e1b63dbd1294485286a25a01dcc74e90/users/3cfe9ca3b3a248b7b27e094a9ae778d4/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:39.007385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b63dbd1294485286a25a01dcc74e90, user_id=3cfe9ca3b3a248b7b27e094a9ae778d4, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:39.010590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:39.023610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1185/2353] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:38 2022] PUT /identity/v3/projects/e1b63dbd1294485286a25a01dcc74e90/users/3cfe9ca3b3a248b7b27e094a9ae778d4/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:39.034955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:39.035349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:39.035974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:39.063612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] MFA Rules not processed for user `3cfe9ca3b3a248b7b27e094a9ae778d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:39.064834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:39.136777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1169/2354] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:39.148798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:39.150549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:39.206867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0593c-93cb-4a01-a541-5d0493174529 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:39.210575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:39.211219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:39.211501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:39.211807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:39.221045 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:39.222463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:39.231927 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1186/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:39.279295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:39.280868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:39.292928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a8e5-7146-44e8-a4b0-63b96ae3e3d2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:39.296612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15d97-1f38-4bf8-b864-be8129b69829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:39.297257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15d97-1f38-4bf8-b864-be8129b69829 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:39.297544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15d97-1f38-4bf8-b864-be8129b69829 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:39.297824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15d97-1f38-4bf8-b864-be8129b69829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:39.356328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15d97-1f38-4bf8-b864-be8129b69829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:39.357773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15d97-1f38-4bf8-b864-be8129b69829 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:39.369055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1170/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:42.815609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:42.849609 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:42.850115 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:42.851061 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:42.870399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:42.871791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:42.893901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c89ed-46a4-406f-b3e8-8f0dc617bed4 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:42.899025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:42.900505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:42.900859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:42.901067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] PATH_INFO: `/v3/users/6a2f9231f5e0489d8061c3b5e96a49a3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:42.902697 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2f9231f5e0489d8061c3b5e96a49a3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:42.904662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:42.923357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:42.933532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1171/2357] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:41:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:41:42.961561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2f9231f5e0489d8061c3b5e96a49a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:42.970142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2f9231f5e0489d8061c3b5e96a49a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:42.979236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:42.985364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:42.986361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2f9231f5e0489d8061c3b5e96a49a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:42.986909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:42.987708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2f9231f5e0489d8061c3b5e96a49a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:42.996840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e18d071d-8fd7-4a4c-a0d7-0fe6a8f3f13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2f9231f5e0489d8061c3b5e96a49a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:43.002906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1187/2358] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:41:42 2022] DELETE /identity/v3/users/6a2f9231f5e0489d8061c3b5e96a49a3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:43.007690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:43.008098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:43.008379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:43.027646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:43.029374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:43.062581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09cd5e-aa7c-4715-be8d-275a0391d3b2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:43.097310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1188/2359] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:43.108387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:43.109884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:43.136263 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:43.136929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:43.137214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:43.137493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:43.139460 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:43.181678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4e041-9cb4-480b-ab92-d6d4c7ff20ef None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:43.185454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:43.186287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:43.186575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:43.186882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:43.198247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:43.200117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:43.210609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1189/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:41:43.212174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:43.213794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:43.223820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1172/2361] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:41:43.677420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:43.679278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:43.701246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c03a26-7e1c-4cee-af65-ef94aae76993 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:43.711338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:43.712246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:43.712492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:43.712815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] PATH_INFO: `/v3/projects/616057d23bff431f8837ecea5c2aa82f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:43.714148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616057d23bff431f8837ecea5c2aa82f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:43.716427 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:43.779107 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616057d23bff431f8837ecea5c2aa82f', 'request_id': 'req-ea2ad790-37c8-43bc-af37-379193a863a9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:43.789401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616057d23bff431f8837ecea5c2aa82f', 'request_id': 'req-ea2ad790-37c8-43bc-af37-379193a863a9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:43.798016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616057d23bff431f8837ecea5c2aa82f', 'request_id': 'req-ea2ad790-37c8-43bc-af37-379193a863a9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:43.824929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] The token cache is being invalidate because project 616057d23bff431f8837ecea5c2aa82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:41:43.825624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:43.827291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:43.829794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1190/2362] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:41:43 2022] DELETE /identity/v3/projects/616057d23bff431f8837ecea5c2aa82f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:43.834822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:43.848798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a679-9b09-459e-8ad7-d5183b508e08 service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:43.903292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:43.929300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:43.930126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:43.930413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:43.930690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] PATH_INFO: `/v3/users/3cfe9ca3b3a248b7b27e094a9ae778d4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:43.931934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfe9ca3b3a248b7b27e094a9ae778d4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:43.933932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:43.997924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfe9ca3b3a248b7b27e094a9ae778d4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.012000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfe9ca3b3a248b7b27e094a9ae778d4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.034633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfe9ca3b3a248b7b27e094a9ae778d4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.036095 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfe9ca3b3a248b7b27e094a9ae778d4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.045808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-06e31eba-fb27-4e0a-8d55-327546498cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfe9ca3b3a248b7b27e094a9ae778d4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.053465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1173/2363] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:41:43 2022] DELETE /identity/v3/users/3cfe9ca3b3a248b7b27e094a9ae778d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:41:44.402044 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:44.403621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:44.426012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad790-37c8-43bc-af37-379193a863a9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:44.436621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:44.512142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:44.514295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:44.515306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:44.515964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] PATH_INFO: `/v3/projects/e1b63dbd1294485286a25a01dcc74e90` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:44.517501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b63dbd1294485286a25a01dcc74e90)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:44.520698 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:44.602468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b63dbd1294485286a25a01dcc74e90', 'request_id': 'req-6ad343b8-41b7-4114-968e-e1147e08b36e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.612154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b63dbd1294485286a25a01dcc74e90', 'request_id': 'req-6ad343b8-41b7-4114-968e-e1147e08b36e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.618599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b63dbd1294485286a25a01dcc74e90', 'request_id': 'req-6ad343b8-41b7-4114-968e-e1147e08b36e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.635804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] The token cache is being invalidate because project e1b63dbd1294485286a25a01dcc74e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:41:44.636117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.636761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ad343b8-41b7-4114-968e-e1147e08b36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:44.638757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1191/2364] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:41:44 2022] DELETE /identity/v3/projects/e1b63dbd1294485286a25a01dcc74e90 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:44.643892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852c7a-0890-42c4-830c-306336581a2d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:44.644887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852c7a-0890-42c4-830c-306336581a2d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:44.645250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852c7a-0890-42c4-830c-306336581a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:44.670810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-21852c7a-0890-42c4-830c-306336581a2d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:44.672355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-21852c7a-0890-42c4-830c-306336581a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:44.803813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1174/2365] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:44.811394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:44.811680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:44.812078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:44.838773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:44.840098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:44.852746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1192/2366] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:44.856992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852c7a-0890-42c4-830c-306336581a2d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:44.868139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852c7a-0890-42c4-830c-306336581a2d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:44.874322 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:44.875000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:44.875282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:44.875554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:44.876571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:41:44.876895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:44.878704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:44.895905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1175/2367] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:41:44.898420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:44.908651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6d341-77cb-44de-bb9e-8575d40cd2ee None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:44.914346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:44.915030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:44.915342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:44.915587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:44.916351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:44.918249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:44.949397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1193/2368] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:41:44 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:44.954252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:44.966367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e592a-4f93-42e9-8e52-5da7b8501692 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.033300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:45.049313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.050004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.050948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.051240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.052147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.054078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.079207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1176/2369] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:41:44 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:45.083054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.093969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cb438-0ffc-4b29-bf3e-2c95de2cada9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.098904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.099607 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.099922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.100216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.100960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.102608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.120778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1194/2370] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:45.122001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.133361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fb70a-3538-4d8b-9466-cac7f234acc5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.138411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e60fc5-b8f3-4324-9556-7fc51d420bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.139309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e60fc5-b8f3-4324-9556-7fc51d420bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.140079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e60fc5-b8f3-4324-9556-7fc51d420bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.140399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e60fc5-b8f3-4324-9556-7fc51d420bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.141147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e60fc5-b8f3-4324-9556-7fc51d420bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.142782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e60fc5-b8f3-4324-9556-7fc51d420bb5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.159610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1177/2371] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:45.161976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.172971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a6bc2-459a-4249-bd34-2a62ac067ff8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.177839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.178726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.179013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.179287 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] PATH_INFO: `/v3/projects/70d2b4a27dc84b8f85a5994cf5a59262/users/828cd5032be242b09161022f31866f83/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.197302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d2b4a27dc84b8f85a5994cf5a59262, user_id=828cd5032be242b09161022f31866f83, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.200534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.217625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1195/2372] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:45 2022] PUT /identity/v3/projects/70d2b4a27dc84b8f85a5994cf5a59262/users/828cd5032be242b09161022f31866f83/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:45.228250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.228543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.228817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.258826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] MFA Rules not processed for user `828cd5032be242b09161022f31866f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:45.260101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:45.340119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1178/2373] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:45.345455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.383592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:45.424029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75dbff-acd1-4f9b-bbbe-6222f4f45fa9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.428936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.429608 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.430029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.430311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.431016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.437887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.473225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1196/2374] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:41:45 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:41:45.474488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.487379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f4fc-00ca-4a77-93c9-a32dd827e921 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.556843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.557700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.557987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.558268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.559154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.561385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.588827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1179/2375] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:41:45 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:45.592735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.605461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f733-2fe2-4870-91a4-89ddf76f573c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.612086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.612843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.613823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.614161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.614960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.616909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.629431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1197/2376] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:45.634343 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.646454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc80e-595a-4fcd-8602-2e159cf0f4c1 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.651427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.652443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.652731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.653042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] PATH_INFO: `/v3/projects/f7cf3924a73a4d93bdc2646abb538226/users/ede75e40c59a4ec9b6cf4ebe8e6916fe/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.671045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cf3924a73a4d93bdc2646abb538226, user_id=ede75e40c59a4ec9b6cf4ebe8e6916fe, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.674091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.689199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1180/2377] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:45 2022] PUT /identity/v3/projects/f7cf3924a73a4d93bdc2646abb538226/users/ede75e40c59a4ec9b6cf4ebe8e6916fe/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:41:45.694123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.705429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218d781-82b2-419b-952b-8f2664d20319 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.777568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1becc3-e460-48b0-a45b-0c0ffbc89113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.778187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1becc3-e460-48b0-a45b-0c0ffbc89113 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.778480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1becc3-e460-48b0-a45b-0c0ffbc89113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.778805 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1becc3-e460-48b0-a45b-0c0ffbc89113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.779559 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1becc3-e460-48b0-a45b-0c0ffbc89113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.781275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1becc3-e460-48b0-a45b-0c0ffbc89113 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.799476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1198/2378] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:45.828868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:45.828868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b628700-c0ce-4071-bd53-c6664ff28d3e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:45.828868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:45.828868 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.833791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.833791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] PATH_INFO: `/v3/projects/f7cf3924a73a4d93bdc2646abb538226/users/ede75e40c59a4ec9b6cf4ebe8e6916fe/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.833791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cf3924a73a4d93bdc2646abb538226, user_id=ede75e40c59a4ec9b6cf4ebe8e6916fe, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:45.837564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:45.852247 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1181/2379] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:45 2022] PUT /identity/v3/projects/f7cf3924a73a4d93bdc2646abb538226/users/ede75e40c59a4ec9b6cf4ebe8e6916fe/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:45.862826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:45.863436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:45.863532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:45.903371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] MFA Rules not processed for user `ede75e40c59a4ec9b6cf4ebe8e6916fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:45.904660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:46.001506 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1199/2380] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:46.022472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:46.024297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:46.043094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:46.099833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dfaa7-ec6f-4f1a-8f5c-f89829c2c1c9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:46.107970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215baa-f29a-4e80-856e-577bb4eed5d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:46.108787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215baa-f29a-4e80-856e-577bb4eed5d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:46.109069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215baa-f29a-4e80-856e-577bb4eed5d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:46.109478 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215baa-f29a-4e80-856e-577bb4eed5d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:46.126571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215baa-f29a-4e80-856e-577bb4eed5d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:46.128840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215baa-f29a-4e80-856e-577bb4eed5d1 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:46.140959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1182/2381] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:46.299025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:46.339338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:46.380771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161c1d1-9682-40f2-bf75-2116d436a45f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:46.387765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:46.388891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:46.389176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:46.389452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] PATH_INFO: `/v3/users/828cd5032be242b09161022f31866f83` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:46.390936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=828cd5032be242b09161022f31866f83)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:46.392962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:46.448744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828cd5032be242b09161022f31866f83'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:46.460029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828cd5032be242b09161022f31866f83'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:46.475443 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828cd5032be242b09161022f31866f83'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:46.476760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828cd5032be242b09161022f31866f83'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:46.485002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828cd5032be242b09161022f31866f83'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:46.496840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1200/2382] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:41:46 2022] DELETE /identity/v3/users/828cd5032be242b09161022f31866f83 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:46.498523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:46.498816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:46.499091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:46.520421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:46.521773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:46.598354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1183/2383] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:46.610637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:46.612137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:46.685873 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a20c4-7812-43c2-87a5-87cba14fdbbf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:46.691300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:46.692053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:46.692352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:46.692619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:46.705173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:46.707291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:46.717836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1201/2384] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:47.064985 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:47.066997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:47.079358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3eb92-7a6b-4a99-8d47-618aee89eb89 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:47.085476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:47.086642 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:47.088375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:47.088375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] PATH_INFO: `/v3/projects/70d2b4a27dc84b8f85a5994cf5a59262` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:47.089432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d2b4a27dc84b8f85a5994cf5a59262)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:47.091466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:47.172539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d2b4a27dc84b8f85a5994cf5a59262', 'request_id': 'req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.186997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d2b4a27dc84b8f85a5994cf5a59262', 'request_id': 'req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.198353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d2b4a27dc84b8f85a5994cf5a59262', 'request_id': 'req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.214979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] The token cache is being invalidate because project 70d2b4a27dc84b8f85a5994cf5a59262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:41:47.215429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.216125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.218034 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1184/2385] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:41:47 2022] DELETE /identity/v3/projects/70d2b4a27dc84b8f85a5994cf5a59262 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:47.225231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:47.236615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6da4e-b499-4e1c-99f4-19bf281d89cf service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:47.300688 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:47.319310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:47.320210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:47.320495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:47.320898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] PATH_INFO: `/v3/users/ede75e40c59a4ec9b6cf4ebe8e6916fe` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:47.322262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede75e40c59a4ec9b6cf4ebe8e6916fe)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:47.327880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:47.385741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede75e40c59a4ec9b6cf4ebe8e6916fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.396237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede75e40c59a4ec9b6cf4ebe8e6916fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.414467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede75e40c59a4ec9b6cf4ebe8e6916fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.415211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede75e40c59a4ec9b6cf4ebe8e6916fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.424187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb13d403-5a7c-4221-b9d8-4c9b43429cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede75e40c59a4ec9b6cf4ebe8e6916fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.430971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1202/2386] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:41:47 2022] DELETE /identity/v3/users/ede75e40c59a4ec9b6cf4ebe8e6916fe => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:47.753974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:47.755515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:47.784446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459daac0-7fcf-44eb-a7aa-92cb05b5d2e8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:47.858707 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:47.906081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:47.906964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:47.907250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:47.907520 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] PATH_INFO: `/v3/projects/f7cf3924a73a4d93bdc2646abb538226` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:47.908773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cf3924a73a4d93bdc2646abb538226)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:47.911502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:47.970826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cf3924a73a4d93bdc2646abb538226', 'request_id': 'req-113ac396-021b-41bb-b42f-23267aca1d49'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.979900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cf3924a73a4d93bdc2646abb538226', 'request_id': 'req-113ac396-021b-41bb-b42f-23267aca1d49'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:47.985545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cf3924a73a4d93bdc2646abb538226', 'request_id': 'req-113ac396-021b-41bb-b42f-23267aca1d49'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:48.002927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] The token cache is being invalidate because project f7cf3924a73a4d93bdc2646abb538226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:41:48.003286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:48.003983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-113ac396-021b-41bb-b42f-23267aca1d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:41:48.005648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1185/2387] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:41:47 2022] DELETE /identity/v3/projects/f7cf3924a73a4d93bdc2646abb538226 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:48.011331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.011620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.011991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.031660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:48.033769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:48.107488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1203/2388] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:48.116080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.116617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.116802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.136384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:48.137706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:48.149994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1186/2389] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:48.151394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.161761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d048ef3-0a8c-4a23-9ce4-bad58877e7d9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.168479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.169261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.169550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.169829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.170566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:41:48.170875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.172604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.190114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1204/2390] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:41:48.195081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.208687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f29cc-112c-48e7-adae-6742519284b5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.213903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.214575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.214864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.215136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.216262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.220394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.255325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.267059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1187/2391] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:41:48 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:48.272936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ccb62-52b3-4354-a7c4-5bbb2b35fafb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.376441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:48.397335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.398379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.398845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.399288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.400211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.402358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.432594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1205/2392] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:41:48 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:48.442138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.460745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917b967-cab2-458a-9599-8d3214c3baa4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.465833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.466516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.466800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.467077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.467876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.469494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.490184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1188/2393] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:48.494247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.505260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ad44-7701-4756-afe1-f5f68e3b1a2a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.511345 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91520-f025-4839-ae77-c35bff49fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.512018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91520-f025-4839-ae77-c35bff49fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.512305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91520-f025-4839-ae77-c35bff49fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.512580 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91520-f025-4839-ae77-c35bff49fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.513356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91520-f025-4839-ae77-c35bff49fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.515331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91520-f025-4839-ae77-c35bff49fff9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.530302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1206/2394] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:48.536807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.548041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a6cd-5c99-4bc4-9628-157127b72f35 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.553923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.555764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.555764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.555764 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] PATH_INFO: `/v3/projects/744dca4f4f594592880fa9a3110d979f/users/8a443915306b43acb8357e0f1e7baa39/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.577968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744dca4f4f594592880fa9a3110d979f, user_id=8a443915306b43acb8357e0f1e7baa39, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.580688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.595398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1189/2395] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:48 2022] PUT /identity/v3/projects/744dca4f4f594592880fa9a3110d979f/users/8a443915306b43acb8357e0f1e7baa39/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:48.600766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc95ce-b50e-4023-ac39-3e535d63a3cd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.601150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc95ce-b50e-4023-ac39-3e535d63a3cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.601475 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc95ce-b50e-4023-ac39-3e535d63a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.626556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e2bc95ce-b50e-4023-ac39-3e535d63a3cd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:48.628205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2bc95ce-b50e-4023-ac39-3e535d63a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:48.694783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1207/2396] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:48.704917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:48.706824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:48.776206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335971eb-69e3-468b-98e4-70a681852745 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:48.780074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:48.780757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:48.781041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:48.781319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:48.793465 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:48.794925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:48.810915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1190/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:49.572241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:49.573626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:49.574116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:49.609414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] MFA Rules not processed for user `8a443915306b43acb8357e0f1e7baa39`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:49.611147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:49.714456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1208/2398] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:49.714801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:49.726856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:49.730718 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2c2f7-0bc1-4fe6-96f2-d54ca971f011 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:49.736971 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:49.737900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:49.738380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:49.738836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:49.739692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:49.741938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:49.781148 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1191/2399] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:41:49 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:49.785733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:49.798865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf3589-fda2-42af-924c-0863aa0e35af None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:49.881612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:49.882420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:49.882765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:49.883110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:49.883922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:49.885931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:49.898376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:49.914971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1209/2400] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:41:49 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:41:49.917902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:49.936658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e0dd4-ac4a-492b-b5dd-3b0599210c5f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:49.942492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:49.943175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:49.943455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:49.943749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:49.944516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:49.946093 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:49.966103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1192/2401] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:49.970279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:49.991382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674850fe-4373-469a-a45a-cd5d2fb23149 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:49.997084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:49.997995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:49.998342 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:49.998627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] PATH_INFO: `/v3/projects/8230fc6d37604cf9bc7ef35e675d9d8b/users/80552107f3e7460d985da4e010555f71/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:50.016926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8230fc6d37604cf9bc7ef35e675d9d8b, user_id=80552107f3e7460d985da4e010555f71, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:50.020437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:50.035776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1210/2402] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:49 2022] PUT /identity/v3/projects/8230fc6d37604cf9bc7ef35e675d9d8b/users/80552107f3e7460d985da4e010555f71/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:50.039822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:50.050553 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb40d8-5b63-4fb3-bc54-e06c87853116 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:50.129335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473fe8-8cc7-44d4-9ba2-db5239ad22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:50.129929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473fe8-8cc7-44d4-9ba2-db5239ad22b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:50.130214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473fe8-8cc7-44d4-9ba2-db5239ad22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:50.130494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473fe8-8cc7-44d4-9ba2-db5239ad22b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:50.131228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473fe8-8cc7-44d4-9ba2-db5239ad22b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:50.132872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473fe8-8cc7-44d4-9ba2-db5239ad22b9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:50.145431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1193/2403] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:41:50.149331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:50.160283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211022f-8fbc-4516-ae36-07baeedbc0b2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:50.165412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf6caf-20bc-44ae-91d8-f4794dd367ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:50.166483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6caf-20bc-44ae-91d8-f4794dd367ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:50.166803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6caf-20bc-44ae-91d8-f4794dd367ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:50.167066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6caf-20bc-44ae-91d8-f4794dd367ca admin admin] PATH_INFO: `/v3/projects/8230fc6d37604cf9bc7ef35e675d9d8b/users/80552107f3e7460d985da4e010555f71/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:50.171101 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6caf-20bc-44ae-91d8-f4794dd367ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8230fc6d37604cf9bc7ef35e675d9d8b, user_id=80552107f3e7460d985da4e010555f71, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:50.174016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6caf-20bc-44ae-91d8-f4794dd367ca admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:50.185848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1211/2404] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:41:50 2022] PUT /identity/v3/projects/8230fc6d37604cf9bc7ef35e675d9d8b/users/80552107f3e7460d985da4e010555f71/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:41:51.048081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:51.048734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:51.048734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:51.095983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] MFA Rules not processed for user `80552107f3e7460d985da4e010555f71`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:51.097724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:51.197376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1194/2405] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:41:51.208526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:51.209133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:51.209325 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:51.233474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] MFA Rules not processed for user `8a443915306b43acb8357e0f1e7baa39`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:41:51.234761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:51.308756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1212/2406] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:41:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:41:51.320508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:51.321919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:51.381349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:51.407900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3760ab-631c-4c6e-b989-139456efd767 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:51.415062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:51.415861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:51.416223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:51.416569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:51.425808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:51.427637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:51.437908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1195/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:51.654742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:51.656226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:51.674982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cbe14-e995-4293-b866-5b5b7b8d89b1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:51.692452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:51.693437 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:51.693748 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:51.694075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:51.696253 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:51.699466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:51.777137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebbd1-cf6b-426c-857c-7f924bb4abc3 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:51.781169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:51.781862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:51.782155 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:51.782434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:51.784685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:51.785136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:51.787057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:51.798167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:51.799649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:51.800040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1213/2408] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:51.815509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1196/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:52.323208 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:52.325658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:52.442369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:52.448058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3f48b-0e9b-499f-a333-b7d92f51630f service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:52.455893 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:52.456784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:52.457754 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:52.458389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:52.462166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:52.477708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:52.479522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:52.494309 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1214/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:53.767287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:53.769467 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:53.780937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c2101-c84a-45f2-8ed4-a632f02e2eb1 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:53.784665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:53.785316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:53.785603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:53.785877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:53.787999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:53.805736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:53.805736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927d004-8e68-4846-a9eb-7883ca6f8fd1 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:53.828245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1197/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:41:55.369763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:41:55.382534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00225-74e5-4c48-b0b2-fc033dd0af28 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:41:55.389436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:41:55.390362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:41:55.390651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:41:55.390931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:41:55.392804 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:41:55.406029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:41:55.407619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:41:55.418816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1215/2412] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:41:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:01.095205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:01.095205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:01.095205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:01.111689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:01.113480 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:01.178743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1198/2413] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:42:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:01.191300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:01.192911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:01.264388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a249a1-99b0-4230-b043-e489a2784ec3 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:01.271060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:01.271778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:01.272069 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:01.272354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:01.281707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:01.283402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:01.293613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1216/2414] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:02.702214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:02.724487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e4b7-a02e-41e0-875f-96723068a176 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:02.730859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:02.731822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:02.732438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:02.732794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:02.734933 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:02.768757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:02.770537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a003f9-d7d0-409b-adfe-b4b9b95ee647 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:02.782545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1199/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:11.289477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=42 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:12.778271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=73 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:15.319649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:15.321333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:15.385796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412cfcb-bae3-4350-afcf-c0bb35b822e1 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:15.389755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:15.390429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:15.390715 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:15.391020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:15.402599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:15.404295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:15.415593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1217/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:20.258988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:20.259502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:20.259610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:20.278805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:20.280035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:20.287861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1200/2417] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 20 09:42:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:20.301368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:20.312368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d244-5450-438e-9a20-fabab8b0f434 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:20.317530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:20.318178 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:20.318482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:20.318756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:20.327601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:20.329211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:20.338441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1218/2418] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:42:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 09:42:22.052878 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:22.075008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9065c06-a6c1-48c3-93ce-2e4a9e41fa14 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:22.086331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:22.087096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:22.087649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:22.089089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:22.092554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:22.124420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:22.126574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:22.146036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1201/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:28.392553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:28.401977 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57901e06-1447-4ebc-8e87-4d729f3fc9bd service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:28.405653 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:28.406282 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:28.406560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:28.406841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:28.409128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:28.478652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:28.480134 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:28.490601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1219/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:28.791743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:28.807809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420915c-45b1-4899-b2b4-33017dcfa572 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:28.811677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:28.812372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:28.812660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:28.812937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:28.815002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:28.835092 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:28.836614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:28.847446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1202/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:32.168020 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:32.171534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:32.195272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3fc03-7bc8-476b-8cc3-c030b37cd7d7 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:32.209261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:32.210310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:32.210660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:32.211007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] PATH_INFO: `/v3/users/4247e1dc34ef44c5b933e105d170911d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:32.212363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4247e1dc34ef44c5b933e105d170911d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:32.218004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:32.320474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4247e1dc34ef44c5b933e105d170911d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.331751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4247e1dc34ef44c5b933e105d170911d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.353376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4247e1dc34ef44c5b933e105d170911d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.354250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4247e1dc34ef44c5b933e105d170911d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.360096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:32.369543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-aca4d299-7fd9-4f24-96a2-f3ab530ff1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4247e1dc34ef44c5b933e105d170911d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.378569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1220/2422] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:32 2022] DELETE /identity/v3/users/4247e1dc34ef44c5b933e105d170911d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:32.641666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:32.655885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924caf-8127-473d-acbc-0fbf8a03cf7d service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:32.758180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:32.759397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:32.759753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:32.760065 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] PATH_INFO: `/v3/projects/2c6eb750eb17435daef4cc8cb2f53103` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:32.761418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6eb750eb17435daef4cc8cb2f53103)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:32.763382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:32.819130 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6eb750eb17435daef4cc8cb2f53103', 'request_id': 'req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.837888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6eb750eb17435daef4cc8cb2f53103', 'request_id': 'req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.849406 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6eb750eb17435daef4cc8cb2f53103', 'request_id': 'req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.862967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] The token cache is being invalidate because project 2c6eb750eb17435daef4cc8cb2f53103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:32.863482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.864245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-34f844b6-a7fa-4b8c-b347-f523ee12bf9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:32.866431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1203/2423] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:32 2022] DELETE /identity/v3/projects/2c6eb750eb17435daef4cc8cb2f53103 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:32.871151 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:32.871868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:32.872308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:32.894458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:32.895755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:32.975682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1221/2424] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:32.979325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:32.980178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:32.980648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.011187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:33.013062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.024872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1204/2425] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:33.029407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.040117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844f2f6-f0c7-4f97-80e5-d37090b657b0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.045093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.045950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.046165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.046592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.047028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.047793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.048012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:33.048903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.050519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.066778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1222/2426] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:42:33.068666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.084170 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cc0b2-0f45-4188-ac90-c6d07056aef4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.090349 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.091158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.091670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.092139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.093099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.096014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.120731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:33.134214 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1223/2427] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:33 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:33.135212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.137017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.151938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be3f97-f853-4d52-a903-6f1a701d3e9a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.223087 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.224097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.224445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.224769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.226822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.230041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60966e79-097d-4bc2-8b15-cb49d6e2da00 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.234943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.236449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.236800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.237298 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] PATH_INFO: `/v3/users/2c6ad0ad11944b81accd2f70a322d176` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.238625 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6ad0ad11944b81accd2f70a322d176)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.241072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.244807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.246668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.258303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1205/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:33.259273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.270476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344508c-bdc5-4ea3-95aa-514ec0aac65b service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.279570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.283915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.284433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.284846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.285835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.288331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.316519 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6ad0ad11944b81accd2f70a322d176'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.322298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1206/2429] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:33 2022] POST /identity/v3/users => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:33.326661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.328299 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6ad0ad11944b81accd2f70a322d176'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.338074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c0736-62d9-4fbb-9325-2a65cc0a5173 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.339014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:33.344964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.346002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.346376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.346743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.347826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.348849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6ad0ad11944b81accd2f70a322d176'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.349769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6ad0ad11944b81accd2f70a322d176'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.350225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.362399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6ad0ad11944b81accd2f70a322d176'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.366758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1207/2430] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:33.368147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.370444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.373992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1224/2431] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:33 2022] DELETE /identity/v3/users/2c6ad0ad11944b81accd2f70a322d176 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:33.387069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b48a74-6b30-47b7-a72d-9c8faf59f1af admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.453542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de111929-98ed-4308-9356-d570b579acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.454225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de111929-98ed-4308-9356-d570b579acda admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.454559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de111929-98ed-4308-9356-d570b579acda admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.455510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de111929-98ed-4308-9356-d570b579acda admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.456099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de111929-98ed-4308-9356-d570b579acda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.457706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de111929-98ed-4308-9356-d570b579acda admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.473442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1208/2432] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:33.474564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.488214 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489cbae-1bb8-4649-b349-9e52ed4ec6f3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.495166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.496422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.497159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.497494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] PATH_INFO: `/v3/projects/dccd769cd11e48e1bbd7a79fd004791b/users/3317b86c542e4ac7be37843b325557ae/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.515042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccd769cd11e48e1bbd7a79fd004791b, user_id=3317b86c542e4ac7be37843b325557ae, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.518678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.535084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1225/2433] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:33 2022] PUT /identity/v3/projects/dccd769cd11e48e1bbd7a79fd004791b/users/3317b86c542e4ac7be37843b325557ae/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:33.545261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.545659 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.546036 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.591710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.594230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.594726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] MFA Rules not processed for user `3317b86c542e4ac7be37843b325557ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:33.596156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.644307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:33.671213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1209/2434] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:33.680717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b99ec0-fc60-452c-91b9-32861ef9615d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.682573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.683978 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.686182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.687006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.687297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.687574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] PATH_INFO: `/v3/projects/1629e2ef448c4dd9883264a4a310df5e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.689423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1629e2ef448c4dd9883264a4a310df5e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.691270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.752624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1629e2ef448c4dd9883264a4a310df5e', 'request_id': 'req-98a470df-1600-4fdf-88d0-445c8c28134f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.760877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1629e2ef448c4dd9883264a4a310df5e', 'request_id': 'req-98a470df-1600-4fdf-88d0-445c8c28134f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.766746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd61b-db6a-4937-a001-b37f2ef8cd3e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.768182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1629e2ef448c4dd9883264a4a310df5e', 'request_id': 'req-98a470df-1600-4fdf-88d0-445c8c28134f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.779403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] The token cache is being invalidate because project 1629e2ef448c4dd9883264a4a310df5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:33.779687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.780466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-98a470df-1600-4fdf-88d0-445c8c28134f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:33.782027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1226/2435] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:33 2022] DELETE /identity/v3/projects/1629e2ef448c4dd9883264a4a310df5e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:33.786808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e073dc-2049-4fb2-98e0-b1f85d700236 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.787106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e073dc-2049-4fb2-98e0-b1f85d700236 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.787375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e073dc-2049-4fb2-98e0-b1f85d700236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.805909 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-37e073dc-2049-4fb2-98e0-b1f85d700236 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:33.807110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-37e073dc-2049-4fb2-98e0-b1f85d700236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.850318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.850994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.851273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.851543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.853129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:33.853534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.873291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1227/2436] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:33.883452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.883763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.884175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.904219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:33.905436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:33.916594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.918212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.918910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1228/2437] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:33.923054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.928903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1210/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:33.933060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c4905-91ee-4057-96c9-378e1b57bf48 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.938563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.939808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.940092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.940411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.941139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:33.941445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.943032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:33.955083 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1229/2439] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:42:33.962002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:33.971949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097decc-3fff-4918-b3b4-7a435a2b3340 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:33.982725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:33.983402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:33.983680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:33.983980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:33.984699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:33.989619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.005150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:34.023360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1211/2440] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:33 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:34.024847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.037859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fc354-394f-44e0-8445-c2dcfb2af599 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.103862 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.104038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.104321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.104599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.105293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.107212 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.132517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1230/2441] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:34 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:34.133883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.155216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5f39-ba30-446a-9371-d7c206bd81e5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.155216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.155216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.155216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.156987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.156987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.156987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.159047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.159645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:34.168128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1212/2442] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:34.171828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.172210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bea58-32bf-4777-8ee0-5c5c4519fc9f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.177763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.178599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.178929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.179259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] PATH_INFO: `/v3/users/3317b86c542e4ac7be37843b325557ae` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.180683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3317b86c542e4ac7be37843b325557ae)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.182613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.183625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804b96-dc7b-4fb1-b1e7-4e4ee70bf2b1 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.188500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.189214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.189494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.189914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.190641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.192279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.202519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1213/2443] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:34.206901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.217060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808819-77f0-4127-8bc7-340cde31a64c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.222375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ad6b-b65f-4b05-96fb-00a0e0c23e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.223241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ad6b-b65f-4b05-96fb-00a0e0c23e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.223523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ad6b-b65f-4b05-96fb-00a0e0c23e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.223825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ad6b-b65f-4b05-96fb-00a0e0c23e2c admin admin] PATH_INFO: `/v3/projects/434f8734257e42ce91fa38d84279be65/users/151481c2f55b494c877ba1e83df66ae4/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.230723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3317b86c542e4ac7be37843b325557ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:34.240530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3317b86c542e4ac7be37843b325557ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:34.255453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3317b86c542e4ac7be37843b325557ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:34.256328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3317b86c542e4ac7be37843b325557ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:34.264822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cb505f7b-b80d-440d-8809-812aeb9cc59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3317b86c542e4ac7be37843b325557ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:34.271905 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1231/2444] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:34 2022] DELETE /identity/v3/users/3317b86c542e4ac7be37843b325557ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:34.276389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.276677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.276958 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.295960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:34.297193 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:34.329836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:34.363557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ad6b-b65f-4b05-96fb-00a0e0c23e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=434f8734257e42ce91fa38d84279be65, user_id=151481c2f55b494c877ba1e83df66ae4, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.366227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ad6b-b65f-4b05-96fb-00a0e0c23e2c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.367883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1232/2445] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:34.378386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.379706 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:34.380332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1214/2446] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:34 2022] PUT /identity/v3/projects/434f8734257e42ce91fa38d84279be65/users/151481c2f55b494c877ba1e83df66ae4/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:34.391355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.391636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.392048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.419238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] MFA Rules not processed for user `151481c2f55b494c877ba1e83df66ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:34.420486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:34.449609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593e4b4-1909-4f65-946b-75bd81fb203a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.494010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1215/2447] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:34.498590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.500584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:34.506739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.507486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.508062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.508419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.578228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.579887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.581112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6724e-e806-4f3f-bde8-e7da1fb5a1f7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.586391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.587119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.587409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.587692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.588499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.590726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.591943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1233/2448] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:34.627456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1216/2449] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:34 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:34.628594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.640707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecbf29-83e3-4159-bd09-74c2df0b600c service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.691959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:34.731365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.732336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.732716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.733088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.734473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.737503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.769509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1234/2450] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:34 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:34.773966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.788539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ef8c-fdba-4823-b7c5-56f09da86756 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.805683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.810507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.810725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.811113 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.812257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.814483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.835643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1217/2451] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:34.836916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.847330 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3211-6e4d-4612-91db-a7794209a0ef admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.852106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.853012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.853310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.853610 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] PATH_INFO: `/v3/projects/e32c6c982771442094ed2a8bb10c20f9/users/e0fef86aba974e498206c6a73e742615/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.870179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32c6c982771442094ed2a8bb10c20f9, user_id=e0fef86aba974e498206c6a73e742615, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.872916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.888680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1235/2452] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:34 2022] PUT /identity/v3/projects/e32c6c982771442094ed2a8bb10c20f9/users/e0fef86aba974e498206c6a73e742615/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:34.893023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.904117 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26486612-63b1-45a3-a977-abc44d43dcf6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:34.913090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:34.926982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:34.929271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:34.973683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:34.974360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:34.974636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:34.974935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:34.975662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:34.977282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:34.988569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1218/2453] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:34.992683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.002910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaccc1-e287-46e4-a55d-e6833d4226a2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.008347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1a278-f76c-4c21-8c5d-a4a6ac759b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.009329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1a278-f76c-4c21-8c5d-a4a6ac759b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.009630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1a278-f76c-4c21-8c5d-a4a6ac759b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.009892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1a278-f76c-4c21-8c5d-a4a6ac759b69 admin admin] PATH_INFO: `/v3/projects/e32c6c982771442094ed2a8bb10c20f9/users/e0fef86aba974e498206c6a73e742615/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.012057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1a278-f76c-4c21-8c5d-a4a6ac759b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32c6c982771442094ed2a8bb10c20f9, user_id=e0fef86aba974e498206c6a73e742615, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.014930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1a278-f76c-4c21-8c5d-a4a6ac759b69 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.025012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6030-e8cd-4e6e-b7b0-82f732927a47 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.025961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1219/2454] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:34 2022] PUT /identity/v3/projects/e32c6c982771442094ed2a8bb10c20f9/users/e0fef86aba974e498206c6a73e742615/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:35.036762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.037238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.037600 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.065673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] MFA Rules not processed for user `e0fef86aba974e498206c6a73e742615`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:35.066891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.083896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.084764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.085047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.085323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] PATH_INFO: `/v3/projects/dccd769cd11e48e1bbd7a79fd004791b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.086533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccd769cd11e48e1bbd7a79fd004791b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.088502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.136617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccd769cd11e48e1bbd7a79fd004791b', 'request_id': 'req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:35.138328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1220/2455] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:35.139656 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:35.145829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccd769cd11e48e1bbd7a79fd004791b', 'request_id': 'req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:35.150807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.152261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.154284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccd769cd11e48e1bbd7a79fd004791b', 'request_id': 'req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:35.166916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] The token cache is being invalidate because project dccd769cd11e48e1bbd7a79fd004791b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:35.167322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:35.168118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4be7fdc4-1558-4a63-b2d9-88b1e0603c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:35.169777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1236/2456] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:34 2022] DELETE /identity/v3/projects/dccd769cd11e48e1bbd7a79fd004791b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:35.175836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abb706-1182-40a6-834a-e6c49b6bbbf1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.176128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abb706-1182-40a6-834a-e6c49b6bbbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.176429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abb706-1182-40a6-834a-e6c49b6bbbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.196027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e5abb706-1182-40a6-834a-e6c49b6bbbf1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:35.197242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e5abb706-1182-40a6-834a-e6c49b6bbbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.208834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6294d6e-cb36-435f-86d3-536d6337e3e8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.243644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:35.258964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1237/2457] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:35.263469 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.264461 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.264742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.265067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.266912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.267100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.267205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.267490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.285637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:35.286949 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.295387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1238/2458] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:35.300032 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.309249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c30b-d3c4-447a-8ad2-c2666cea5276 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.314407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.315064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.315353 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.315629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.316406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:35.316716 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.318320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.330439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1239/2459] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:42:35.332557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.334255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.334764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.344245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e86c8-e144-4492-ac76-6af6f2aefc2b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.344559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1221/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:35.349599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.350248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.350531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.350849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.351476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.353400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.379940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1240/2461] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:35.384171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.395596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ade2a-42ec-4551-9a33-3bfddc51940a service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.429996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.431784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.468457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.469146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.469431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.469776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.471109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.472931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.492704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363b074-0b97-4625-b5ab-1d7027e9e8bd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.493505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1222/2462] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:35.496404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.497126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.497407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.497630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.497747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.499473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.507774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2e8c-ec6c-40a2-a6b3-5fde856ec4d7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.512668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.513264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.513547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.513820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.514801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.516484 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.527066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1223/2463] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:35.531370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.541466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb33d7a-de79-4672-a996-ad19dce74ade admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.547522 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.548257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.548543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.548817 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.549531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.550327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:35.551260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.562126 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1224/2464] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:35.565365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.566440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.568665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351ab61-5704-4f91-b6d7-847ca01d536c service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.577075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6cbf-88b8-46b5-a983-14b71101c889 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.579057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1241/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:35.582445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.583347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.583632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.583941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] PATH_INFO: `/v3/projects/fa1b650f0d904e3eaadd890475a3edef/users/8d4e164b339343d2a4b0164e3dc11566/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.600291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1b650f0d904e3eaadd890475a3edef, user_id=8d4e164b339343d2a4b0164e3dc11566, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.602917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.616995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1225/2466] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:35 2022] PUT /identity/v3/projects/fa1b650f0d904e3eaadd890475a3edef/users/8d4e164b339343d2a4b0164e3dc11566/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:35.630082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.630371 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.630657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.659281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] MFA Rules not processed for user `8d4e164b339343d2a4b0164e3dc11566`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:35.661169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:35.731779 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1242/2467] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:35.736285 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.770119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:35.803376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14af0-21fd-470a-b480-eae1a10eb941 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.809758 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.811372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.811372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.811372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.812055 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.814517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.843029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1226/2468] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:35.847150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.861060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee817c-adbd-4b16-b79c-99bcef8b9702 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.924094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.924674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.924962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.925568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.926822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.928229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.950223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1243/2469] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:35 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:35.954293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.964883 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a51b92-5d26-4ea2-8880-8b47d6e3db0a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:35.971895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:35.971895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:35.971895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:35.971895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:35.972298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:35.973070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:35.983887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1227/2470] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:35.988543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:35.998866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460395b7-8b50-4b48-b29f-5027eed30652 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:36.004359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:36.005251 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:36.005543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:36.005832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] PATH_INFO: `/v3/projects/4d8148bb8f1c4a758cbe386ef21a220a/users/a00f9b5e2acf4215852cfbf3ba8f5fb5/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:36.023528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8148bb8f1c4a758cbe386ef21a220a, user_id=a00f9b5e2acf4215852cfbf3ba8f5fb5, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:36.026244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:36.043154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1244/2471] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:35 2022] PUT /identity/v3/projects/4d8148bb8f1c4a758cbe386ef21a220a/users/a00f9b5e2acf4215852cfbf3ba8f5fb5/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:36.047064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:36.062264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29897dc-168b-47f1-a747-114c3837dc27 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:36.123239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc68cca-3aad-43e3-9fb2-4350f28e8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:36.124096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc68cca-3aad-43e3-9fb2-4350f28e8e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:36.124462 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc68cca-3aad-43e3-9fb2-4350f28e8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:36.124671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc68cca-3aad-43e3-9fb2-4350f28e8e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:36.125378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc68cca-3aad-43e3-9fb2-4350f28e8e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:36.127562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc68cca-3aad-43e3-9fb2-4350f28e8e1e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:36.138873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1228/2472] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:36.143467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:36.154088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc0f7-4789-4c18-a4d2-b36d21f822a0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:36.159098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:36.159889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:36.160247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:36.160755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] PATH_INFO: `/v3/projects/4d8148bb8f1c4a758cbe386ef21a220a/users/a00f9b5e2acf4215852cfbf3ba8f5fb5/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:36.162915 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8148bb8f1c4a758cbe386ef21a220a, user_id=a00f9b5e2acf4215852cfbf3ba8f5fb5, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:36.165637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:36.177379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1245/2473] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:36 2022] PUT /identity/v3/projects/4d8148bb8f1c4a758cbe386ef21a220a/users/a00f9b5e2acf4215852cfbf3ba8f5fb5/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:36.188062 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:36.188356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:36.188639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:36.217810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] MFA Rules not processed for user `a00f9b5e2acf4215852cfbf3ba8f5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:36.218963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:36.300818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1229/2474] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:36 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:36.312028 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:36.314661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:36.353034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:36.378374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b598c-840f-4ad7-bb9a-0e11af976cc1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:36.383166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:36.383814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:36.384100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:36.384419 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:36.398387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:36.400014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:36.410481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1246/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:36 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:36.486275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:36.496531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d12c-e969-4391-9187-28db36ea91ad None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:36.500410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ebf06-cbba-4da4-a73d-1138dbfbc744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:36.501059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ebf06-cbba-4da4-a73d-1138dbfbc744 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:36.501369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ebf06-cbba-4da4-a73d-1138dbfbc744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:36.501765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ebf06-cbba-4da4-a73d-1138dbfbc744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:36.523057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:36.563838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ebf06-cbba-4da4-a73d-1138dbfbc744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:36.565268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ebf06-cbba-4da4-a73d-1138dbfbc744 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:36.575602 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1230/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:39.295465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:39.361202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f59ae-0a34-43a6-bf6f-a21b5d42f5a2 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:39.365852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:39.366733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:39.367017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:39.367297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] PATH_INFO: `/v3/users/8d4e164b339343d2a4b0164e3dc11566` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:39.368530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4e164b339343d2a4b0164e3dc11566)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:39.370490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:39.432857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4e164b339343d2a4b0164e3dc11566'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.443176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4e164b339343d2a4b0164e3dc11566'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.458495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4e164b339343d2a4b0164e3dc11566'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.459523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4e164b339343d2a4b0164e3dc11566'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.479355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4e164b339343d2a4b0164e3dc11566'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.490937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1247/2477] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:39 2022] DELETE /identity/v3/users/8d4e164b339343d2a4b0164e3dc11566 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:39.492544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:39.493703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:39.493991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:39.515691 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:39.517336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:39.591968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1231/2478] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:39.603826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:39.605630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:39.691013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b30a0c-2bf3-45f4-85d8-a30e875747ba admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:39.699255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:39.700060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:39.700581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:39.700961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:39.717399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:39.719303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:39.724479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:39.733481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1248/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:39.801787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:39.811243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:39.831190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aac83c-45d7-462e-912c-9dde08ee3f2b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:39.836056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:39.836940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:39.837219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:39.837486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] PATH_INFO: `/v3/users/8a443915306b43acb8357e0f1e7baa39` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:39.839192 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a443915306b43acb8357e0f1e7baa39)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:39.840728 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:39.902427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a443915306b43acb8357e0f1e7baa39'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.910443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a443915306b43acb8357e0f1e7baa39'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.928831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a443915306b43acb8357e0f1e7baa39'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.930608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a443915306b43acb8357e0f1e7baa39'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.941426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a443915306b43acb8357e0f1e7baa39'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:39.949703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1232/2480] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:39 2022] DELETE /identity/v3/users/8a443915306b43acb8357e0f1e7baa39 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:40.120558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:40.122570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:40.142156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896d22a-73d4-4884-afa6-1e6bfb7418ca service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:40.182801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:40.185515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:40.225184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:40.226305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:40.227284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:40.227913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] PATH_INFO: `/v3/projects/fa1b650f0d904e3eaadd890475a3edef` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:40.229281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1b650f0d904e3eaadd890475a3edef)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:40.231340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:40.238372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:40.270445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a5c5c-25a3-4078-8239-e05173366594 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:40.275167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:40.276165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:40.276355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:40.276637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] PATH_INFO: `/v3/projects/744dca4f4f594592880fa9a3110d979f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:40.277889 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=744dca4f4f594592880fa9a3110d979f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:40.279858 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:40.286242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1b650f0d904e3eaadd890475a3edef', 'request_id': 'req-c45cd96a-cd67-4643-ab61-c3ca0fb69186'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.294523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1b650f0d904e3eaadd890475a3edef', 'request_id': 'req-c45cd96a-cd67-4643-ab61-c3ca0fb69186'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.301096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1b650f0d904e3eaadd890475a3edef', 'request_id': 'req-c45cd96a-cd67-4643-ab61-c3ca0fb69186'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.312836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] The token cache is being invalidate because project fa1b650f0d904e3eaadd890475a3edef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:40.313127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.313883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.316169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1249/2481] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:40 2022] DELETE /identity/v3/projects/fa1b650f0d904e3eaadd890475a3edef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:40.319961 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:40.321382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:40.329941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744dca4f4f594592880fa9a3110d979f', 'request_id': 'req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.341905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744dca4f4f594592880fa9a3110d979f', 'request_id': 'req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.349422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744dca4f4f594592880fa9a3110d979f', 'request_id': 'req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.363269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] The token cache is being invalidate because project 744dca4f4f594592880fa9a3110d979f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:40.363559 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.364269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.365826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1233/2482] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:40 2022] DELETE /identity/v3/projects/744dca4f4f594592880fa9a3110d979f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:40.370431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:40.372210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:40.392274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd96a-cd67-4643-ab61-c3ca0fb69186 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:40.427477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:40.438375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1045e-5a4a-48d3-9b8d-3e456e54b35e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:40.443635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:40.444582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:40.444863 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:40.445167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] PATH_INFO: `/v3/users/80552107f3e7460d985da4e010555f71` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:40.446375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80552107f3e7460d985da4e010555f71)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:40.448306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:40.456261 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:40.457232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:40.457552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:40.457830 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] PATH_INFO: `/v3/users/a00f9b5e2acf4215852cfbf3ba8f5fb5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:40.459059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00f9b5e2acf4215852cfbf3ba8f5fb5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:40.461105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:40.499434 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80552107f3e7460d985da4e010555f71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.508059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80552107f3e7460d985da4e010555f71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.512690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00f9b5e2acf4215852cfbf3ba8f5fb5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.519528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:40.522189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80552107f3e7460d985da4e010555f71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.522439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00f9b5e2acf4215852cfbf3ba8f5fb5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.522891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80552107f3e7460d985da4e010555f71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.531590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80552107f3e7460d985da4e010555f71'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.535395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00f9b5e2acf4215852cfbf3ba8f5fb5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.536102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00f9b5e2acf4215852cfbf3ba8f5fb5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.538288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1234/2483] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:40 2022] DELETE /identity/v3/users/80552107f3e7460d985da4e010555f71 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:40.543265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00f9b5e2acf4215852cfbf3ba8f5fb5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.549845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1250/2484] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:40 2022] DELETE /identity/v3/users/a00f9b5e2acf4215852cfbf3ba8f5fb5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:40.739648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:40.741243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:40.813435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22e85f-31bd-4d40-9f7d-bb54f4fdc903 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:40.864367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:40.866375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:40.886930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:40.887850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:40.888134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:40.888409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] PATH_INFO: `/v3/projects/8230fc6d37604cf9bc7ef35e675d9d8b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:40.890106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8230fc6d37604cf9bc7ef35e675d9d8b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:40.897893 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:40.947195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8230fc6d37604cf9bc7ef35e675d9d8b', 'request_id': 'req-e856c10d-f3be-4fc6-bebf-af5b52877707'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.951864 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba4ff-3387-4725-bbf9-6d386792b6fa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:40.955006 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8230fc6d37604cf9bc7ef35e675d9d8b', 'request_id': 'req-e856c10d-f3be-4fc6-bebf-af5b52877707'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.961899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8230fc6d37604cf9bc7ef35e675d9d8b', 'request_id': 'req-e856c10d-f3be-4fc6-bebf-af5b52877707'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.973427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] The token cache is being invalidate because project 8230fc6d37604cf9bc7ef35e675d9d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:40.973711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.974358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e856c10d-f3be-4fc6-bebf-af5b52877707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:40.975946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1235/2485] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:40 2022] DELETE /identity/v3/projects/8230fc6d37604cf9bc7ef35e675d9d8b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:40.980644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dfc83-77db-41b5-857b-1aeae94339c5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:40.980928 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dfc83-77db-41b5-857b-1aeae94339c5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:40.981198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dfc83-77db-41b5-857b-1aeae94339c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:40.999328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-365dfc83-77db-41b5-857b-1aeae94339c5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:41.000637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-365dfc83-77db-41b5-857b-1aeae94339c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.012194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.013066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.013347 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.013630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] PATH_INFO: `/v3/projects/4d8148bb8f1c4a758cbe386ef21a220a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.015073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8148bb8f1c4a758cbe386ef21a220a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.017026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.018384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:41.019628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:41.066267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1236/2486] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:41.068384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8148bb8f1c4a758cbe386ef21a220a', 'request_id': 'req-ee151bff-204d-4885-9f47-040ade7d548a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:41.075052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.075552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.075925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.076146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8148bb8f1c4a758cbe386ef21a220a', 'request_id': 'req-ee151bff-204d-4885-9f47-040ade7d548a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:41.082402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8148bb8f1c4a758cbe386ef21a220a', 'request_id': 'req-ee151bff-204d-4885-9f47-040ade7d548a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:41.093647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] The token cache is being invalidate because project 4d8148bb8f1c4a758cbe386ef21a220a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:41.093939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:41.094594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ee151bff-204d-4885-9f47-040ade7d548a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:41.095266 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:41.096235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1251/2487] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:40 2022] DELETE /identity/v3/projects/4d8148bb8f1c4a758cbe386ef21a220a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:41.101097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.102035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abcdf9-be3b-47fe-ba5d-baee8f05112a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.102380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abcdf9-be3b-47fe-ba5d-baee8f05112a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.102723 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abcdf9-be3b-47fe-ba5d-baee8f05112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.122950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-74abcdf9-be3b-47fe-ba5d-baee8f05112a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:41.124227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-74abcdf9-be3b-47fe-ba5d-baee8f05112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.166286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1237/2488] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:41.170470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.179596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca08b4-ee3e-4f55-810c-d662cf1a2b22 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.184915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.185577 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.185884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.186166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.186892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:41.187201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.188415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1252/2489] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:41.188831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.197268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.197586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.197829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.207917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1238/2490] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:42:41.211853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.218006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:41.219229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.226031 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e009-6c03-431d-a442-f33e0d44e844 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.228179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1253/2491] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:41.232128 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.232404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.232918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.233270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.233616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.234668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.236747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.249139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21626ec9-2179-4bdf-aa7d-595138d376e4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.255483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.256401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.256670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.256952 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.258301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:41.258630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.261238 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.271579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1239/2492] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:41.275997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1254/2493] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:42:41.276835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.282286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.295004 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f386f-55c5-49c9-b98f-abbdf2e33cbb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.352410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aa007-e5ea-4323-af05-5a15e55cac34 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.358200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.358639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.358925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.359276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.359959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.362612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.365008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.365683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.365967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.366248 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.366940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.368924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.387349 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1240/2494] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:41.392256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.397710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:41.403084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9faa27-3e1c-4098-8705-8881807950ff admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.412710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1255/2495] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:41.413540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.413684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.414378 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.414734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.415129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.415963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.417746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.430282 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1241/2496] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:41.434482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.445242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d99b5-5f26-42ca-a4b9-3041bda18291 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.449777 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:41.499411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239657c9-a47c-41de-8066-5eccc23718dc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.508003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.508705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.508992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.509263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.510079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.512394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.520255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.520941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.521242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.521517 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.522241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.523861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.534656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1242/2497] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:41.539211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.545078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1256/2498] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:41.546218 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.551379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a90c4-5037-432d-b1ea-5cec1fe2cafe admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.556836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8567c0-62e5-49c6-b50a-1e06a374c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.557765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8567c0-62e5-49c6-b50a-1e06a374c4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.558044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8567c0-62e5-49c6-b50a-1e06a374c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.558312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8567c0-62e5-49c6-b50a-1e06a374c4e8 admin admin] PATH_INFO: `/v3/projects/809a47a86a7a4f958d6dd82f261d8b56/users/e7025bda4f274ea1b25748cf583db0c4/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.558670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5544-e18d-41b3-ae38-20b7fd3aefe9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.563666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.564403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.564818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.565005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.565765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.567924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.577827 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8567c0-62e5-49c6-b50a-1e06a374c4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809a47a86a7a4f958d6dd82f261d8b56, user_id=e7025bda4f274ea1b25748cf583db0c4, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.580988 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8567c0-62e5-49c6-b50a-1e06a374c4e8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.584614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1257/2499] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:41.585717 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.597948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1243/2500] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:41 2022] PUT /identity/v3/projects/809a47a86a7a4f958d6dd82f261d8b56/users/e7025bda4f274ea1b25748cf583db0c4/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:41.599007 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4abce4-55fb-433b-93e4-2719a94bbe2a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.608033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.608332 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.608766 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.646884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] MFA Rules not processed for user `e7025bda4f274ea1b25748cf583db0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:41.648136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.671488 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.672228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.672637 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.672931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.673740 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.675534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.686183 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1258/2501] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:41.692064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.702272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbc5aa-2105-45ff-a1f9-89cfff72104a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.707896 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eb108-f81a-4e59-b16e-a4de57a071fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.708794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eb108-f81a-4e59-b16e-a4de57a071fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.709521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eb108-f81a-4e59-b16e-a4de57a071fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.709521 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eb108-f81a-4e59-b16e-a4de57a071fe admin admin] PATH_INFO: `/v3/projects/0b148da2052d49f89631d7e332ad2aa8/users/8b443b77c56e4c2f9707a85d0cf4b3ff/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.723225 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1244/2502] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:41.726858 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eb108-f81a-4e59-b16e-a4de57a071fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b148da2052d49f89631d7e332ad2aa8, user_id=8b443b77c56e4c2f9707a85d0cf4b3ff, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.730524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eb108-f81a-4e59-b16e-a4de57a071fe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.734223 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.735844 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.744910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1259/2503] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:41 2022] PUT /identity/v3/projects/0b148da2052d49f89631d7e332ad2aa8/users/8b443b77c56e4c2f9707a85d0cf4b3ff/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:41.757431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.757719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.757996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.788631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] MFA Rules not processed for user `8b443b77c56e4c2f9707a85d0cf4b3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:41.790184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:41.800475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116658cf-298d-4e1d-a80b-6f2f6b830b3b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.826312 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:41.848030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:41.858477 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.859136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.859417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.859693 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.883589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1260/2504] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:41.888131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:41.919018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.920518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:41.930337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1245/2505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:41.957574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba2ba8-8281-49da-89a3-8776489d0d1e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:41.962320 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:41.962985 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:41.963270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:41.963545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:41.964280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:41.966166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.000564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1261/2506] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:41 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:42.004624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:42.016752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042878cb-98a0-4f23-b99f-12d7afd0d88b service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:42.080914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:42.081688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.081917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.082194 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.082934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:42.085236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.110610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1246/2507] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:42 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:42.111974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:42.122529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d5fc6-61dc-48ef-bd4f-97043ece6e2e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:42.127384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:42.128100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.128385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.128668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.129428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:42.131033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.142268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1262/2508] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:42.147561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:42.159245 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a4ac-c425-43ee-b96c-1cccd89ba209 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:42.165002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:42.165941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.166224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.166499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] PATH_INFO: `/v3/projects/5a13d0fbacf646d9a1c3ca22c8ad4d28/users/5a0dfea757f94453b5588e83ef3e5f17/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.188323 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a13d0fbacf646d9a1c3ca22c8ad4d28, user_id=5a0dfea757f94453b5588e83ef3e5f17, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:42.191232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.206578 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1247/2509] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:42 2022] PUT /identity/v3/projects/5a13d0fbacf646d9a1c3ca22c8ad4d28/users/5a0dfea757f94453b5588e83ef3e5f17/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:42.210327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:42.221876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3340e-1484-4bb3-afbd-2deb33c3b328 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:42.290233 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705305-c0f7-48d3-ac56-690faba53baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:42.290911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705305-c0f7-48d3-ac56-690faba53baa admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.291200 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705305-c0f7-48d3-ac56-690faba53baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.291480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705305-c0f7-48d3-ac56-690faba53baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.292247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705305-c0f7-48d3-ac56-690faba53baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:42.293910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705305-c0f7-48d3-ac56-690faba53baa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.303801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1263/2510] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:42.307956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:42.318070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636128f8-2d10-478c-a0f6-9a4cff4b2e04 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:42.322995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:42.323920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.324201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.324476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] PATH_INFO: `/v3/projects/5a13d0fbacf646d9a1c3ca22c8ad4d28/users/5a0dfea757f94453b5588e83ef3e5f17/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.326556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a13d0fbacf646d9a1c3ca22c8ad4d28, user_id=5a0dfea757f94453b5588e83ef3e5f17, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:42.329451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.340567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1248/2511] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:42 2022] PUT /identity/v3/projects/5a13d0fbacf646d9a1c3ca22c8ad4d28/users/5a0dfea757f94453b5588e83ef3e5f17/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:42.351334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.351629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.351996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.382013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] MFA Rules not processed for user `5a0dfea757f94453b5588e83ef3e5f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:42.383250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:42.422100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:42.454686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1264/2512] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:42.467683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:42.501695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:42.527358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83f8e-4e89-489d-9242-7909dfebcd9b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:42.531041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dcbd5-dbf9-4d66-b792-71966c387291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:42.531685 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcbd5-dbf9-4d66-b792-71966c387291 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:42.531997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcbd5-dbf9-4d66-b792-71966c387291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:42.532269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcbd5-dbf9-4d66-b792-71966c387291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:42.541375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dcbd5-dbf9-4d66-b792-71966c387291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:42.542794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dcbd5-dbf9-4d66-b792-71966c387291 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:42.552280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1249/2513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:43.153080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:43.214446 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9ad2e-42d7-440f-b85f-163254010e6a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:43.219034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:43.219940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:43.220226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:43.220507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] PATH_INFO: `/v3/users/8b443b77c56e4c2f9707a85d0cf4b3ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:43.221704 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b443b77c56e4c2f9707a85d0cf4b3ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:43.223632 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:43.271534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b443b77c56e4c2f9707a85d0cf4b3ff'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.279647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b443b77c56e4c2f9707a85d0cf4b3ff'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.292808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b443b77c56e4c2f9707a85d0cf4b3ff'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.293514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b443b77c56e4c2f9707a85d0cf4b3ff'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.301507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b443b77c56e4c2f9707a85d0cf4b3ff'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.307593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1265/2514] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:43 2022] DELETE /identity/v3/users/8b443b77c56e4c2f9707a85d0cf4b3ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:43.312228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:43.312518 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:43.312791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:43.331445 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:43.333299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:43.400921 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1250/2515] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:43.410953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:43.412592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:43.478502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185cd3-a8f3-4589-b54f-50c18e4eb50e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:43.482459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:43.483129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:43.483415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:43.483681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:43.491753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:43.494615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:43.496560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:43.510329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1266/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:43.829769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:43.832788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:43.849797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e3541-3ef8-4c97-bc55-98b1fa6106df None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:43.854732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:43.855639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:43.856052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:43.856204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] PATH_INFO: `/v3/projects/0b148da2052d49f89631d7e332ad2aa8` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:43.857704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b148da2052d49f89631d7e332ad2aa8)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:43.860189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:43.928605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b148da2052d49f89631d7e332ad2aa8', 'request_id': 'req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.941552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b148da2052d49f89631d7e332ad2aa8', 'request_id': 'req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.950786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b148da2052d49f89631d7e332ad2aa8', 'request_id': 'req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.970877 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] The token cache is being invalidate because project 0b148da2052d49f89631d7e332ad2aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:43.971240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.972102 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:43.973662 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1251/2517] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:43 2022] DELETE /identity/v3/projects/0b148da2052d49f89631d7e332ad2aa8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:43.977737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:43.992400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395965-03e5-44e8-8419-5078a9033faf service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:44.070626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:44.071561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.071883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.072259 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] PATH_INFO: `/v3/users/5a0dfea757f94453b5588e83ef3e5f17` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.073381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0dfea757f94453b5588e83ef3e5f17)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:44.075782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:44.130155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0dfea757f94453b5588e83ef3e5f17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.138654 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0dfea757f94453b5588e83ef3e5f17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.153641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0dfea757f94453b5588e83ef3e5f17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.154368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0dfea757f94453b5588e83ef3e5f17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.162394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d66957d1-2757-4b67-8b73-6ecbb95ff7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0dfea757f94453b5588e83ef3e5f17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.170344 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1267/2518] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:43 2022] DELETE /identity/v3/users/5a0dfea757f94453b5588e83ef3e5f17 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:44.470109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:44.472260 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:44.489147 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0687ab-3f2d-476b-b4d1-e27ab7d45fb0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:44.544005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:44.550492 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:44.551470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.552152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.552643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] PATH_INFO: `/v3/projects/5a13d0fbacf646d9a1c3ca22c8ad4d28` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.554996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a13d0fbacf646d9a1c3ca22c8ad4d28)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:44.557447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:44.605274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a13d0fbacf646d9a1c3ca22c8ad4d28', 'request_id': 'req-c386f484-61ce-4a57-af44-0e84e5fcd46f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.612072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a13d0fbacf646d9a1c3ca22c8ad4d28', 'request_id': 'req-c386f484-61ce-4a57-af44-0e84e5fcd46f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.617506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a13d0fbacf646d9a1c3ca22c8ad4d28', 'request_id': 'req-c386f484-61ce-4a57-af44-0e84e5fcd46f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.629471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] The token cache is being invalidate because project 5a13d0fbacf646d9a1c3ca22c8ad4d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:44.629762 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.630563 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c386f484-61ce-4a57-af44-0e84e5fcd46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:44.632159 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1252/2519] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:44 2022] DELETE /identity/v3/projects/5a13d0fbacf646d9a1c3ca22c8ad4d28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:44.637048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.637511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.637609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.655760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:44.656976 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:44.716414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1268/2520] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:44.725396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.725684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.725983 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.744104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:44.745308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:44.760396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1253/2521] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:44.765201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:44.777384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba50b2-c7bb-46f3-b1d6-79f9e3af64dd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:44.782525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:44.783232 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.783522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.783943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.785329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:44.785903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:44.787747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:44.802228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1269/2522] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:42:44.806795 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:44.817140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8ef49-17e3-4d0e-b42a-e3ebb4ffeb14 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:44.822024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:44.822677 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.822965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.823237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.823993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:44.825910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:44.854114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1254/2523] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:44 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:44.858546 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:44.863759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:44.870185 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2eac-85a5-4faa-8db0-325f0a3d4304 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:44.928451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:44.929129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.929410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.929681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.930372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:44.932333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:44.952489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1270/2524] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:44 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:44.957452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:44.968043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56022a-ff35-4f71-b04a-80e6b89b0427 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:44.972556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:44.973213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:44.973493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:44.973769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:44.974491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:44.976116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:44.986617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1255/2525] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:44.990383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.001295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de349-8b9b-485a-8487-003a7d7e1f08 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.006746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.007464 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.007816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.008100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.009036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.010582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.014582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.017085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.022523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1271/2526] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:45.026459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.032548 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83546-9e49-4049-8fbb-0720732f4951 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.036503 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e8f69-d394-446c-b900-5f6a2fafa370 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.037315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.038213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.038541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.038995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] PATH_INFO: `/v3/users/e7025bda4f274ea1b25748cf583db0c4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.040252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7025bda4f274ea1b25748cf583db0c4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.041684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f5899-7d5d-4f09-baab-e30d4c33fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.042221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.042691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f5899-7d5d-4f09-baab-e30d4c33fbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.043043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f5899-7d5d-4f09-baab-e30d4c33fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.043412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f5899-7d5d-4f09-baab-e30d4c33fbeb admin admin] PATH_INFO: `/v3/projects/87be43c52dda4ef4b0dcfbfdd06bd7a7/users/f72c8472d4d34a90a975928ceee97bc5/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.059363 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f5899-7d5d-4f09-baab-e30d4c33fbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=87be43c52dda4ef4b0dcfbfdd06bd7a7, user_id=f72c8472d4d34a90a975928ceee97bc5, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.062166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f5899-7d5d-4f09-baab-e30d4c33fbeb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.078029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1272/2527] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:45 2022] PUT /identity/v3/projects/87be43c52dda4ef4b0dcfbfdd06bd7a7/users/f72c8472d4d34a90a975928ceee97bc5/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:45.088388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.088678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.088982 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.090543 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7025bda4f274ea1b25748cf583db0c4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.099674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7025bda4f274ea1b25748cf583db0c4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.113262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7025bda4f274ea1b25748cf583db0c4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.114101 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7025bda4f274ea1b25748cf583db0c4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.122943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] MFA Rules not processed for user `f72c8472d4d34a90a975928ceee97bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:45.124290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a7d341fb-2dbe-4ac2-813e-b7355f5c2aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7025bda4f274ea1b25748cf583db0c4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.124494 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.131622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1256/2528] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:45 2022] DELETE /identity/v3/users/e7025bda4f274ea1b25748cf583db0c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:45.135962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.136725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.136725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.159279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:45.160539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.175634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:45.211408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1273/2529] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:45.215932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.217278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.229306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1257/2530] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:45.239654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.241163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.279880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:45.308512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a8bf-0049-4d4d-badf-8277b1804867 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.312164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4509f1-67e2-43fc-9989-f4c5e795498b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.320921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.320921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.320921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.320921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.321332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.321332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.324580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.325255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.325915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.326203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.337880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.339316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.354546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1258/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:45.354682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1274/2532] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:45.357222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.367550 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb59a-567a-45ae-aaa7-7c4603a6ec4c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.444241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.445394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.445973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.446396 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.447234 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.449695 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.473853 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1259/2533] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:45.477752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.494331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bf6ab-5195-48d4-8558-ed1876068faa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.508571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.509837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.509837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.510027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.510771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.512358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.527049 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1275/2534] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:45.531207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.555166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279827-625d-4819-a640-e3d3abcd7aa2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.565444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.565444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.565444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.565444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] PATH_INFO: `/v3/projects/1e3179a5bfbc4cd3a6cc24d42c34af89/users/cd2b3aa306b34ffd9ce7af245dc2bdc0/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.582370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3179a5bfbc4cd3a6cc24d42c34af89, user_id=cd2b3aa306b34ffd9ce7af245dc2bdc0, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.585390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.599384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1260/2535] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:45 2022] PUT /identity/v3/projects/1e3179a5bfbc4cd3a6cc24d42c34af89/users/cd2b3aa306b34ffd9ce7af245dc2bdc0/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:45.603516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.614672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883c72-4458-4863-8ab6-fe54e489b4d0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.677095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.677886 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.678234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.678535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.679449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.681257 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.689131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.691275 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.693557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1276/2536] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:45.697384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.707037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550f0f-f574-4eac-8d23-432e56017d4c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.708564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166644a-d060-4142-8911-04b5457ef769 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.712268 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.713404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.713690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.713970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] PATH_INFO: `/v3/projects/809a47a86a7a4f958d6dd82f261d8b56` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.714127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0817067-c22b-4cd8-8a72-710dda4732ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.715089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817067-c22b-4cd8-8a72-710dda4732ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.715230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809a47a86a7a4f958d6dd82f261d8b56)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.715755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817067-c22b-4cd8-8a72-710dda4732ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.716099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817067-c22b-4cd8-8a72-710dda4732ab admin admin] PATH_INFO: `/v3/projects/1e3179a5bfbc4cd3a6cc24d42c34af89/users/cd2b3aa306b34ffd9ce7af245dc2bdc0/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.717210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.719029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0817067-c22b-4cd8-8a72-710dda4732ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3179a5bfbc4cd3a6cc24d42c34af89, user_id=cd2b3aa306b34ffd9ce7af245dc2bdc0, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.722731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0817067-c22b-4cd8-8a72-710dda4732ab admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.733683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1277/2537] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:45 2022] PUT /identity/v3/projects/1e3179a5bfbc4cd3a6cc24d42c34af89/users/cd2b3aa306b34ffd9ce7af245dc2bdc0/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:45.744628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.744850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.745135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.749782 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:45.772691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] MFA Rules not processed for user `cd2b3aa306b34ffd9ce7af245dc2bdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:45.773628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809a47a86a7a4f958d6dd82f261d8b56', 'request_id': 'req-2a355bc3-3649-4d37-8dff-db666e49ffb0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.773907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.781091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809a47a86a7a4f958d6dd82f261d8b56', 'request_id': 'req-2a355bc3-3649-4d37-8dff-db666e49ffb0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.787397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809a47a86a7a4f958d6dd82f261d8b56', 'request_id': 'req-2a355bc3-3649-4d37-8dff-db666e49ffb0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.798326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] The token cache is being invalidate because project 809a47a86a7a4f958d6dd82f261d8b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:45.798605 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.799305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2a355bc3-3649-4d37-8dff-db666e49ffb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:45.801278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1261/2538] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:45 2022] DELETE /identity/v3/projects/809a47a86a7a4f958d6dd82f261d8b56 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:45.806318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbc19-e8f5-4c62-af6e-b5f1f603d874 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.806608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbc19-e8f5-4c62-af6e-b5f1f603d874 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.806896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbc19-e8f5-4c62-af6e-b5f1f603d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.825046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d77fbc19-e8f5-4c62-af6e-b5f1f603d874 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:45.826264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d77fbc19-e8f5-4c62-af6e-b5f1f603d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.851806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1278/2539] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:45.864447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.866056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.897591 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1262/2540] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:45.903835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:45.905524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.905788 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.906059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.926009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:45.927209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:45.932148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be903-f589-466d-9273-00bf1272abd6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.935279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1263/2541] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:45.935917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.936729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.936947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.937229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.939407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.947480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.948400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78274a-8d5f-4456-80d5-7090ef0508ed None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.948966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.953145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.953803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.954086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.954363 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.955619 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:45.955972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.957557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:45.959563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1279/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:45.969654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1264/2543] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:42:45.974670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:45.985899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0caca-939c-4d35-9e5b-5dcc70b4b3b2 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:45.991269 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:45.992012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:45.992301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:45.992583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:45.993307 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:45.995395 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.025423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1280/2544] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:45 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:46.029292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.040224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0a63e-5267-415d-9061-caff04cd6e1f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.100564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.101313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.101525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.101803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.102497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.104481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.134474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1265/2545] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:46 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:46.139331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.150839 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb191-95c3-4892-806c-4d52549109aa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.155884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.156541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.156921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.157333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.158198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.160046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.172283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1281/2546] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:42:46.176050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.187239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba756c3-db65-4e54-8cdb-02594cb0b496 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.192495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244b764-59b5-40c0-b449-8b7760eb349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.193153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b764-59b5-40c0-b449-8b7760eb349d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.193438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b764-59b5-40c0-b449-8b7760eb349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.193712 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b764-59b5-40c0-b449-8b7760eb349d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.194443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b764-59b5-40c0-b449-8b7760eb349d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.196045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b764-59b5-40c0-b449-8b7760eb349d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.207992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1266/2547] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:46.212462 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.222842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60198b5-76a9-4913-8684-36b185992a92 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.228493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.229410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.229692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.229967 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] PATH_INFO: `/v3/projects/590742f1aa564dcd84f324dff912b5b2/users/1dcfad8981ba42aeae5601df2d69d30f/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.246577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590742f1aa564dcd84f324dff912b5b2, user_id=1dcfad8981ba42aeae5601df2d69d30f, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.249226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.264382 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1282/2548] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:46 2022] PUT /identity/v3/projects/590742f1aa564dcd84f324dff912b5b2/users/1dcfad8981ba42aeae5601df2d69d30f/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:46.331569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.332004 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.332291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.340288 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.342163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:46.352153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:46.361502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] MFA Rules not processed for user `1dcfad8981ba42aeae5601df2d69d30f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:46.363347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:46.416788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3377f-abf2-4ef8-8773-8ac673abb631 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.421705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.422614 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.422898 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.423182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] PATH_INFO: `/v3/users/f72c8472d4d34a90a975928ceee97bc5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.424527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72c8472d4d34a90a975928ceee97bc5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.426455 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.434638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1267/2549] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:46.447307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.448781 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:46.476531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72c8472d4d34a90a975928ceee97bc5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:46.484467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72c8472d4d34a90a975928ceee97bc5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:46.497125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72c8472d4d34a90a975928ceee97bc5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:46.497743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72c8472d4d34a90a975928ceee97bc5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:46.502969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:46.508801 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d37e90-b892-4f5f-95bc-5d45d70eab04 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.509171 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d3fe7b58-61b7-48b4-bff5-f031820c96d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72c8472d4d34a90a975928ceee97bc5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:46.513063 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.513748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.514017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.514547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.516395 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:46.516643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1283/2550] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:46 2022] DELETE /identity/v3/users/f72c8472d4d34a90a975928ceee97bc5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:46.521759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.522050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.522352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.528583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.530144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.539206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1268/2551] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:42:46.539402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:46.540777 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:46.611665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1284/2552] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:42:46.621306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:46.622735 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:46.689706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbac60-f81c-4db2-895f-b06d570133b1 service glance] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:46.752002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:46.752575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:46.752865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:46.753142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:46.765283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:46.768355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:46.780536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1269/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:47.113658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:47.115735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:47.131430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272bccd-3424-46c4-a4cd-962640eeacf1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:47.136553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:47.137466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:47.137751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:47.138029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] PATH_INFO: `/v3/projects/87be43c52dda4ef4b0dcfbfdd06bd7a7` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:47.139563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87be43c52dda4ef4b0dcfbfdd06bd7a7)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:47.143005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:47.195117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87be43c52dda4ef4b0dcfbfdd06bd7a7', 'request_id': 'req-3a540699-4c40-4a6b-8d01-6883869b0242'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.202790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87be43c52dda4ef4b0dcfbfdd06bd7a7', 'request_id': 'req-3a540699-4c40-4a6b-8d01-6883869b0242'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.208616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87be43c52dda4ef4b0dcfbfdd06bd7a7', 'request_id': 'req-3a540699-4c40-4a6b-8d01-6883869b0242'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.220026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] The token cache is being invalidate because project 87be43c52dda4ef4b0dcfbfdd06bd7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:47.220318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.221490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.223033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1285/2554] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:47 2022] DELETE /identity/v3/projects/87be43c52dda4ef4b0dcfbfdd06bd7a7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:47.226992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:47.231932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:47.238620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c4ac-f176-46d3-a6fe-86546fafbf2f service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:47.301074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:47.301967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:47.302257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:47.302725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] PATH_INFO: `/v3/users/cd2b3aa306b34ffd9ce7af245dc2bdc0` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:47.303850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2b3aa306b34ffd9ce7af245dc2bdc0)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:47.305767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:47.353679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2b3aa306b34ffd9ce7af245dc2bdc0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.361048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2b3aa306b34ffd9ce7af245dc2bdc0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.375189 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2b3aa306b34ffd9ce7af245dc2bdc0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.376397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2b3aa306b34ffd9ce7af245dc2bdc0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.386643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd0840c9-7744-4972-bb24-579bf31ae19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2b3aa306b34ffd9ce7af245dc2bdc0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.393151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1270/2555] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:47 2022] DELETE /identity/v3/users/cd2b3aa306b34ffd9ce7af245dc2bdc0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:47.682575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:47.684271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:47.701928 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a540699-4c40-4a6b-8d01-6883869b0242 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:47.762324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:47.763192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:47.763631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:47.763951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] PATH_INFO: `/v3/projects/1e3179a5bfbc4cd3a6cc24d42c34af89` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:47.765414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3179a5bfbc4cd3a6cc24d42c34af89)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:47.767354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:47.789365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:47.821841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3179a5bfbc4cd3a6cc24d42c34af89', 'request_id': 'req-fe942b3d-d953-484d-9209-98d4aa4fcb20'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.829588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3179a5bfbc4cd3a6cc24d42c34af89', 'request_id': 'req-fe942b3d-d953-484d-9209-98d4aa4fcb20'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.836237 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3179a5bfbc4cd3a6cc24d42c34af89', 'request_id': 'req-fe942b3d-d953-484d-9209-98d4aa4fcb20'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.848500 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] The token cache is being invalidate because project 1e3179a5bfbc4cd3a6cc24d42c34af89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:47.848788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.849466 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe942b3d-d953-484d-9209-98d4aa4fcb20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:47.851030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1286/2556] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:47 2022] DELETE /identity/v3/projects/1e3179a5bfbc4cd3a6cc24d42c34af89 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:47.855848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:47.856139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:47.856442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:47.874422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:47.875633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:47.937582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1271/2557] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:47.946184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:47.946476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:47.946755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:47.965642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:47.966854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:47.975145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1287/2558] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:47.979296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:47.989248 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7724b74-3211-443e-8196-59dcb2ec80a2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:47.993999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d83d3-440f-4467-af18-631330add52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:47.994665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d83d3-440f-4467-af18-631330add52e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:47.994944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d83d3-440f-4467-af18-631330add52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:47.995216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d83d3-440f-4467-af18-631330add52e admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:47.995974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d83d3-440f-4467-af18-631330add52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:47.996278 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d83d3-440f-4467-af18-631330add52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:47.997860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d83d3-440f-4467-af18-631330add52e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.010583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1272/2559] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:42:48.015517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.026450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fb28f-c9c0-41ec-97bb-38300be32d9a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.031416 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.032123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.032409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.032685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.033457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.035384 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.062674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1288/2560] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:48 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:48.067634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d83d3-440f-4467-af18-631330add52e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.078156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d83d3-440f-4467-af18-631330add52e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.082996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:48.158337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.159022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.159308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.159585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.160319 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.162412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.183857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1273/2561] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:48 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:48.188079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.200809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9a45-0380-4aba-9bdd-e096fff288dd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.206875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.207628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.207965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.208268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.209081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.210750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.221945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1289/2562] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:48.226239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.237144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0001-d2d7-42e1-995a-547b8b569506 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.241936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055db0-c13b-4304-9837-c18d1c6481a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.242668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055db0-c13b-4304-9837-c18d1c6481a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.243040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055db0-c13b-4304-9837-c18d1c6481a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.243379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055db0-c13b-4304-9837-c18d1c6481a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.244195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055db0-c13b-4304-9837-c18d1c6481a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.245916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055db0-c13b-4304-9837-c18d1c6481a1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.256284 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1274/2563] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:48.260785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.273501 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d059bd-e19f-4b24-a75b-eb182066345e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.279390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.280376 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.280726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.281061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] PATH_INFO: `/v3/projects/57f2574689fc4ef58d3026828c084079/users/93e94c0b502446eda0e42fb2a8c6cf41/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.300404 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f2574689fc4ef58d3026828c084079, user_id=93e94c0b502446eda0e42fb2a8c6cf41, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.303070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.318798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1290/2564] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:48 2022] PUT /identity/v3/projects/57f2574689fc4ef58d3026828c084079/users/93e94c0b502446eda0e42fb2a8c6cf41/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:48.330464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.331475 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.331842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.366045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] MFA Rules not processed for user `93e94c0b502446eda0e42fb2a8c6cf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:48.367255 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:48.453153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1275/2565] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:48.457528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.542017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15905ca7-a232-4116-bf59-f5daaa30a1e1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.546867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.547624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.547989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.548272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.548995 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.551034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.578611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1291/2566] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:48 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:48.583318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.594137 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a289e2-8646-42c3-b677-ebccdc9b7dd7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.649899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.650569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.650849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.651121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.651931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.653820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.673030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1276/2567] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:48 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:42:48.677801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.688126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4068-2a74-4280-b053-74259696eb8b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.692870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.693537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.693821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.694100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.694829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.696483 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.707486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1292/2568] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:48.711791 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.723138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874fac4-f083-43c2-9114-b6b232fa1b3c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.728354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.729308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.729592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.729896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] PATH_INFO: `/v3/projects/a357d4b82e7843e7865126d778fa99fd/users/6001e251d6af46e2bdf4c5640f6b2dbf/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.732589 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:48.748800 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a357d4b82e7843e7865126d778fa99fd, user_id=6001e251d6af46e2bdf4c5640f6b2dbf, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.751586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.765700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1277/2569] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:48 2022] PUT /identity/v3/projects/a357d4b82e7843e7865126d778fa99fd/users/6001e251d6af46e2bdf4c5640f6b2dbf/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:48.770116 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.780409 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609cef-2645-427f-bf58-491689681e65 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.794552 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:48.843219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e26d32-f0b7-4515-9ee2-7beed503a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.843992 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e26d32-f0b7-4515-9ee2-7beed503a6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.844290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e26d32-f0b7-4515-9ee2-7beed503a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.844548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e26d32-f0b7-4515-9ee2-7beed503a6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.845279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e26d32-f0b7-4515-9ee2-7beed503a6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.847513 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e26d32-f0b7-4515-9ee2-7beed503a6a3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.857941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1293/2570] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:48.862141 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:48.872964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14a71-9b46-4385-946a-bece83b55698 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:48.877631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:48.878525 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.878812 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.879091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] PATH_INFO: `/v3/projects/a357d4b82e7843e7865126d778fa99fd/users/6001e251d6af46e2bdf4c5640f6b2dbf/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.881154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a357d4b82e7843e7865126d778fa99fd, user_id=6001e251d6af46e2bdf4c5640f6b2dbf, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:48.883837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:48.895383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1278/2571] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:48 2022] PUT /identity/v3/projects/a357d4b82e7843e7865126d778fa99fd/users/6001e251d6af46e2bdf4c5640f6b2dbf/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:48.906648 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:48.906941 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:48.907220 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:48.935953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] MFA Rules not processed for user `6001e251d6af46e2bdf4c5640f6b2dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:48.937179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:49.007442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1294/2572] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:49.020365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:49.022150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:49.083961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03dab-618d-47a8-9b19-04fbb81ef063 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:49.087507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:49.088183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:49.088471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:49.088742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:49.098328 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:49.099920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:49.110303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1279/2573] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:49.190950 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:49.193420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:49.212119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66d095-8220-4d50-af16-777ac06f1435 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:49.216499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f71a2-289d-4275-8ad8-49c4de0afc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:49.217426 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f71a2-289d-4275-8ad8-49c4de0afc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:49.217731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f71a2-289d-4275-8ad8-49c4de0afc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:49.217983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f71a2-289d-4275-8ad8-49c4de0afc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:49.278724 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f71a2-289d-4275-8ad8-49c4de0afc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:49.280192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f71a2-289d-4275-8ad8-49c4de0afc03 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:49.289153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1295/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:49.557789 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:49.626526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528b1e-68f0-43c5-8ae1-a3098158ed0e service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:49.631490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:49.632495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:49.632783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:49.633060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] PATH_INFO: `/v3/users/93e94c0b502446eda0e42fb2a8c6cf41` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:49.634385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e94c0b502446eda0e42fb2a8c6cf41)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:49.636552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:49.688708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e94c0b502446eda0e42fb2a8c6cf41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:49.695841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e94c0b502446eda0e42fb2a8c6cf41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:49.708675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e94c0b502446eda0e42fb2a8c6cf41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:49.709356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e94c0b502446eda0e42fb2a8c6cf41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:49.711381 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:49.718901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e94c0b502446eda0e42fb2a8c6cf41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:49.725805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1280/2575] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:49 2022] DELETE /identity/v3/users/93e94c0b502446eda0e42fb2a8c6cf41 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:42:49.730530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:49.730815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:49.731092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:49.749481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:49.750694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:49.784476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:49.812741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1296/2576] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:49.823069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:49.824531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:49.884025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f1a9-0892-4663-aae5-bac6d4acf534 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:49.887660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:49.888369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:49.888647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:49.888918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:49.899224 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:49.904514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:49.911297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1281/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:50.192051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:50.193581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:50.213509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb05e-624c-4408-8026-731189b9620b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:50.218430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:50.219889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:50.220182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:50.220589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] PATH_INFO: `/v3/projects/57f2574689fc4ef58d3026828c084079` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:50.221936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f2574689fc4ef58d3026828c084079)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:50.223910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:50.286884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f2574689fc4ef58d3026828c084079', 'request_id': 'req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.294030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f2574689fc4ef58d3026828c084079', 'request_id': 'req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.300626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f2574689fc4ef58d3026828c084079', 'request_id': 'req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.313278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] The token cache is being invalidate because project 57f2574689fc4ef58d3026828c084079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:50.313569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.314947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.316562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1297/2578] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:50 2022] DELETE /identity/v3/projects/57f2574689fc4ef58d3026828c084079 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:50.320699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:50.330416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec035-c4ff-4653-99e0-ac8dbcc06ac1 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:50.388682 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:50.389751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:50.390030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:50.390301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] PATH_INFO: `/v3/users/6001e251d6af46e2bdf4c5640f6b2dbf` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:50.391529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6001e251d6af46e2bdf4c5640f6b2dbf)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:50.393496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:50.446259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6001e251d6af46e2bdf4c5640f6b2dbf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.453657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6001e251d6af46e2bdf4c5640f6b2dbf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.467710 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6001e251d6af46e2bdf4c5640f6b2dbf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.468387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6001e251d6af46e2bdf4c5640f6b2dbf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.476070 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99ceb8df-5cc5-4514-88f7-e8a8f9766bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6001e251d6af46e2bdf4c5640f6b2dbf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.482544 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1282/2579] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:50 2022] DELETE /identity/v3/users/6001e251d6af46e2bdf4c5640f6b2dbf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:50.778417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:50.789202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:50.815932 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83be6c-b7c2-421b-93c1-2fb4f8eb0d34 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:50.882062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:50.885572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:50.885572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:50.885572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] PATH_INFO: `/v3/projects/a357d4b82e7843e7865126d778fa99fd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:50.885572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a357d4b82e7843e7865126d778fa99fd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:50.887078 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:50.934159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a357d4b82e7843e7865126d778fa99fd', 'request_id': 'req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.942712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a357d4b82e7843e7865126d778fa99fd', 'request_id': 'req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.948252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:50.949571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a357d4b82e7843e7865126d778fa99fd', 'request_id': 'req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.963124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] The token cache is being invalidate because project a357d4b82e7843e7865126d778fa99fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:50.963412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.964092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dd7df25-db7c-44a8-8cb7-498a5a1b9a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:50.965618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1298/2580] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:50 2022] DELETE /identity/v3/projects/a357d4b82e7843e7865126d778fa99fd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:50.971131 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:50.971587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:50.971702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:50.989835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:50.991024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:51.000703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:51.057731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1283/2581] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:51.065703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.065997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.066310 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.085118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:51.086322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:51.094271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1299/2582] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:51.099056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.111252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca363c7-67a9-4247-a7fa-e80414e28634 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.116233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.116942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.117226 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.117503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.118239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:42:51.118542 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.120199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.132384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1284/2583] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:42:51.136760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.146840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d107a99-5dc4-4d19-94ad-6a87173af15d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.151566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.152249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.152533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.152821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.153504 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.155388 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.186387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1300/2584] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:42:51 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:51.190504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.200656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446425-6293-4adb-a9a2-cef3c3eb9528 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.260501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.261183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.261468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.261750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.262452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.264696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.286952 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1285/2585] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:42:51 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:42:51.291686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.306149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967f1c2-0ed3-4e91-924c-1b31b9d3bbd7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.311971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.312691 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.313145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.313538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.314271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.315888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.326756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1301/2586] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:51.331457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.341586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec21c7-3ef7-4b97-9a37-d593d2e921d6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.347071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012efa8f-25d4-4ed9-ab81-077c3cf6277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.347792 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012efa8f-25d4-4ed9-ab81-077c3cf6277d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.348083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012efa8f-25d4-4ed9-ab81-077c3cf6277d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.348362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012efa8f-25d4-4ed9-ab81-077c3cf6277d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.349100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012efa8f-25d4-4ed9-ab81-077c3cf6277d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.350745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012efa8f-25d4-4ed9-ab81-077c3cf6277d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.362174 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1286/2587] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:42:51.366186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.376159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72b60-716d-4021-aead-35908fc3c86a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.381236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.382111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.382390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.382659 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] PATH_INFO: `/v3/projects/8f8d9c58a3f84264b5886029bd362614/users/432d077e1c1f40f899628ee1ab059971/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.397792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8d9c58a3f84264b5886029bd362614, user_id=432d077e1c1f40f899628ee1ab059971, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.400548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.415126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1302/2588] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:42:51 2022] PUT /identity/v3/projects/8f8d9c58a3f84264b5886029bd362614/users/432d077e1c1f40f899628ee1ab059971/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:51.425638 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.425933 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.426238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.454365 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] MFA Rules not processed for user `432d077e1c1f40f899628ee1ab059971`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:51.456190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:51.529521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1287/2589] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:51.540767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.542457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:51.603160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b574ca-f615-420f-b7e1-85957c9d4838 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.606792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29caccb-1d32-4be6-956f-d87770102db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.607436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29caccb-1d32-4be6-956f-d87770102db7 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.607742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29caccb-1d32-4be6-956f-d87770102db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.608016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29caccb-1d32-4be6-956f-d87770102db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.616254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29caccb-1d32-4be6-956f-d87770102db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.617612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29caccb-1d32-4be6-956f-d87770102db7 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.626436 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1303/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:51.653300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.663397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:51.719199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2b34f-46de-4f94-b733-484f3502707e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.723987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.724896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.725177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.725454 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] PATH_INFO: `/v3/users/432d077e1c1f40f899628ee1ab059971` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.726657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=432d077e1c1f40f899628ee1ab059971)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:51.728607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:51.776561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432d077e1c1f40f899628ee1ab059971'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:51.783879 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432d077e1c1f40f899628ee1ab059971'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:51.796146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432d077e1c1f40f899628ee1ab059971'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:51.796916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432d077e1c1f40f899628ee1ab059971'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:51.808283 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432d077e1c1f40f899628ee1ab059971'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:51.816022 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1288/2591] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:42:51 2022] DELETE /identity/v3/users/432d077e1c1f40f899628ee1ab059971 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:42:51.820757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.821120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.821401 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:51.838759 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:42:51.840000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:51.915618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1304/2592] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:42:51.921759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:51.923307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:51.983970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700928fe-cd31-4965-9361-7521f716f1be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:51.988084 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:51.988737 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:51.989018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:51.989292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:52.003427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:52.004968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:52.016809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1289/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:42:52.304133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:42:52.305601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:42:52.319058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2920d-8de0-489a-834a-c1fbb27b8997 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:42:52.324217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:42:52.325098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:42:52.325380 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:42:52.325657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] PATH_INFO: `/v3/projects/8f8d9c58a3f84264b5886029bd362614` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:42:52.327125 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8d9c58a3f84264b5886029bd362614)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:42:52.329617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:42:52.373423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:52.398015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8d9c58a3f84264b5886029bd362614', 'request_id': 'req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:52.405425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8d9c58a3f84264b5886029bd362614', 'request_id': 'req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:52.412303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8d9c58a3f84264b5886029bd362614', 'request_id': 'req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:52.424850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] The token cache is being invalidate because project 8f8d9c58a3f84264b5886029bd362614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:42:52.425149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:52.425810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:42:52.431575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1305/2594] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:42:52 2022] DELETE /identity/v3/projects/8f8d9c58a3f84264b5886029bd362614 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:00.382426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:00.394361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ca61-529e-4604-be1d-c6d953fc9191 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:00.430450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:00.453270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:00.453926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:00.454209 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:00.454485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:00.456996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:00.528437 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:00.530149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:00.545149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1290/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:02.420769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:04.033669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.035751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:04.065721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1ecf-42b4-4c6d-9edf-1c13e8535763 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.072834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.073939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.074306 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.074787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] PATH_INFO: `/v3/users/3e9653f2408549da853449559ec820b0` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.076811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9653f2408549da853449559ec820b0)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.078936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.146904 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9653f2408549da853449559ec820b0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.156693 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9653f2408549da853449559ec820b0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.182510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9653f2408549da853449559ec820b0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.184354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9653f2408549da853449559ec820b0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.204564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6309097e-5b7e-47f0-b9eb-c9a495e658fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9653f2408549da853449559ec820b0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.231399 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1306/2596] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:04 2022] DELETE /identity/v3/users/3e9653f2408549da853449559ec820b0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:04.443895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.455476 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3ef1a-9481-4277-86d8-c0b495c73ff5 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.518581 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.519655 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.519818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.520027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] PATH_INFO: `/v3/projects/f5dd328ca98243798776889749e2a8eb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.521327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5dd328ca98243798776889749e2a8eb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.523229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.576834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5dd328ca98243798776889749e2a8eb', 'request_id': 'req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.584671 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5dd328ca98243798776889749e2a8eb', 'request_id': 'req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.590204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5dd328ca98243798776889749e2a8eb', 'request_id': 'req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.601750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] The token cache is being invalidate because project f5dd328ca98243798776889749e2a8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:04.602096 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.602874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e29a76c-80ff-4b72-8cd6-ff5a74a29a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:04.604567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1291/2597] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:04 2022] DELETE /identity/v3/projects/f5dd328ca98243798776889749e2a8eb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:04.609410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.609700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.609984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.629305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:04.630540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:04.692075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1307/2598] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:04.699839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.700132 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.700417 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.718596 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:04.719743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:04.727785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1292/2599] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:04.731963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.742389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727afb0-2090-4c41-8d9d-0238567a6679 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.747159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.747857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.748147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.748428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.749160 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:04.749472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.751067 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.763595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1308/2600] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:04.768304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.775752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:04.780555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9bbb-9082-4a46-b9c5-771f7d702e50 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.786979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.787905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.788380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.788724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.789603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.791545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.818303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1293/2601] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:04 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:04.822405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.832575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059b7b-1d2b-4fbb-85e2-0b1bf75de866 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.889202 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.889880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.890162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.890434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.891127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.893087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.899690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:04.916244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1309/2602] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:04 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:04.920350 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.930637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637269d3-b720-4bbb-b5f9-4b44a4715caa admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.935515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.936232 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.936744 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.937038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.937809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.939447 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.950549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1294/2603] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:04.954560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.965215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d145a52-9927-4253-8037-eeb8d6b99b63 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:04.969939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ced7a-b8df-48f4-807c-0b6e392ccd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:04.970548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ced7a-b8df-48f4-807c-0b6e392ccd0b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:04.970832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ced7a-b8df-48f4-807c-0b6e392ccd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:04.971113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ced7a-b8df-48f4-807c-0b6e392ccd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:04.971882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ced7a-b8df-48f4-807c-0b6e392ccd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:04.973473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ced7a-b8df-48f4-807c-0b6e392ccd0b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:04.983502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1310/2604] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:04.987567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:04.997750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655990aa-b28e-492a-a6e9-0fcbdd88620e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:05.002661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:05.004449 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:05.004783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:05.005121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] PATH_INFO: `/v3/projects/554bec8699024b64a07edd629e25616c/users/37f8b3b382ae4ffd87cc743787754225/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:05.021443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554bec8699024b64a07edd629e25616c, user_id=37f8b3b382ae4ffd87cc743787754225, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:05.024152 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:05.038106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1295/2605] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:04 2022] PUT /identity/v3/projects/554bec8699024b64a07edd629e25616c/users/37f8b3b382ae4ffd87cc743787754225/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:05.043428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:05.043963 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:05.044064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:05.063682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:05.064943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:05.123889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1311/2606] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:05.134011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:05.135756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:05.192731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697bbc-452b-4d5a-a83b-a3f9496d2db3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:05.196409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221c52-5c45-4e29-b9d4-8c7f21af7246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:05.197049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221c52-5c45-4e29-b9d4-8c7f21af7246 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:05.197331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221c52-5c45-4e29-b9d4-8c7f21af7246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:05.197595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221c52-5c45-4e29-b9d4-8c7f21af7246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:05.207083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221c52-5c45-4e29-b9d4-8c7f21af7246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:05.208510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221c52-5c45-4e29-b9d4-8c7f21af7246 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:05.217726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1296/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:05.746066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:05.747510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:05.760296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90edba-4222-4923-8133-39ae2f3593f9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:05.765684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:05.766102 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:05.766548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:05.766962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] PATH_INFO: `/v3/users/151481c2f55b494c877ba1e83df66ae4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:05.769096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] RBAC: Authorizing `identity:delete_user(user_id=151481c2f55b494c877ba1e83df66ae4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:05.771166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:05.822065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151481c2f55b494c877ba1e83df66ae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:05.829918 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151481c2f55b494c877ba1e83df66ae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:05.844387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151481c2f55b494c877ba1e83df66ae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:05.846203 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151481c2f55b494c877ba1e83df66ae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:05.855115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-772f48a9-2390-4d99-bdae-b12348d3129d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151481c2f55b494c877ba1e83df66ae4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:05.861489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1312/2608] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:05 2022] DELETE /identity/v3/users/151481c2f55b494c877ba1e83df66ae4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:05.866299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:05.866840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:05.866840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:05.887167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:05.888634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:05.915423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:05.916086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:05.916619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:05.949937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] MFA Rules not processed for user `37f8b3b382ae4ffd87cc743787754225`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:05.951161 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:05.959079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1297/2609] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:05.968709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:05.972773 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:05.999396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:06.030638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1313/2610] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:06.035592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.037799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:06.046526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813b30f-4ff3-4c53-a680-f627ca16bfac None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.050910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.051657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.052038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.052398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.052605 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed89b-8956-4764-bb62-2b1fe5d212e6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.057765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.058434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.058750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.059164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:06.059402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.060140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.062327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.063502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.064972 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.078292 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1298/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:43:06.096479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1314/2612] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:06 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:06.100823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.114440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2566d-09cd-4c20-9b1c-59e7251ffd6f service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.179645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.180356 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.180632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.180909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.181610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.183504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.207421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1299/2613] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:06 2022] POST /identity/v3/users => generated 308 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:06.208678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.218945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ee29f-92cd-4ebc-b37f-f1eb8a70732e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.224064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.224735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.225012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.225313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.226014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.227604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.242094 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1315/2614] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:06.245027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.257049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099b31-2500-4f2b-8456-5aa4f70133ce admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.261798 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.262690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.263121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.263403 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] PATH_INFO: `/v3/projects/c7fd97b22b6145bca6a27caaecfc81f4/users/1e1ad3bd001c468195976f4b5007b5f1/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.280090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fd97b22b6145bca6a27caaecfc81f4, user_id=1e1ad3bd001c468195976f4b5007b5f1, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.282734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.297370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1300/2615] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:06 2022] PUT /identity/v3/projects/c7fd97b22b6145bca6a27caaecfc81f4/users/1e1ad3bd001c468195976f4b5007b5f1/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:06.301751 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.312210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c3096-0af1-4049-9c9d-519aab76f29d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.372936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.374752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:06.378529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.380005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.380304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.380761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.381673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.383264 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.390774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2394f0-8f78-49c4-999d-2b3704b9d1c8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.396077 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.396242 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1316/2616] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:06.398185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.398399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.398888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] PATH_INFO: `/v3/projects/434f8734257e42ce91fa38d84279be65` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.400910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=434f8734257e42ce91fa38d84279be65)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.401030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.403185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.412456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14495e-541a-477d-8153-cb41c10e454a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.417630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.418529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.418818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.419099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] PATH_INFO: `/v3/projects/c7fd97b22b6145bca6a27caaecfc81f4/users/1e1ad3bd001c468195976f4b5007b5f1/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.421291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fd97b22b6145bca6a27caaecfc81f4, user_id=1e1ad3bd001c468195976f4b5007b5f1, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.424026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.435973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1317/2617] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:06 2022] PUT /identity/v3/projects/c7fd97b22b6145bca6a27caaecfc81f4/users/1e1ad3bd001c468195976f4b5007b5f1/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:06.453519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434f8734257e42ce91fa38d84279be65', 'request_id': 'req-8abea1c9-8a0f-49c9-90ce-cf498068f51a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.461765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434f8734257e42ce91fa38d84279be65', 'request_id': 'req-8abea1c9-8a0f-49c9-90ce-cf498068f51a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.468392 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434f8734257e42ce91fa38d84279be65', 'request_id': 'req-8abea1c9-8a0f-49c9-90ce-cf498068f51a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.481331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] The token cache is being invalidate because project 434f8734257e42ce91fa38d84279be65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:06.481628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.482318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.483927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1301/2618] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:06 2022] DELETE /identity/v3/projects/434f8734257e42ce91fa38d84279be65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:06.488415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:06.490173 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:06.568396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed653d-9e6d-4316-9fc6-d878b76d5c68 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:06.660923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:06.693917 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:06.694870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:06.695162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:06.695442 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] PATH_INFO: `/v3/users/e0fef86aba974e498206c6a73e742615` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:06.696948 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fef86aba974e498206c6a73e742615)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:06.698944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:06.759538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fef86aba974e498206c6a73e742615'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.769681 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fef86aba974e498206c6a73e742615'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.783131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fef86aba974e498206c6a73e742615'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.784037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fef86aba974e498206c6a73e742615'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.792005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce64d13c-3eb1-4bed-a7ba-c63eeb490ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fef86aba974e498206c6a73e742615'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:06.798766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1318/2619] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:06 2022] DELETE /identity/v3/users/e0fef86aba974e498206c6a73e742615 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:07.233178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.245083 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abea1c9-8a0f-49c9-90ce-cf498068f51a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.256372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488f830-5c8c-4819-b49d-f3eac6c19836 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.257189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488f830-5c8c-4819-b49d-f3eac6c19836 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.257189 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488f830-5c8c-4819-b49d-f3eac6c19836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.295229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b488f830-5c8c-4819-b49d-f3eac6c19836 None None] MFA Rules not processed for user `1e1ad3bd001c468195976f4b5007b5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:07.296428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b488f830-5c8c-4819-b49d-f3eac6c19836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:07.307585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:07.334734 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.335644 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.336049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.336233 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] PATH_INFO: `/v3/projects/e32c6c982771442094ed2a8bb10c20f9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.337466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32c6c982771442094ed2a8bb10c20f9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.339390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.401362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1319/2620] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:07.404583 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32c6c982771442094ed2a8bb10c20f9', 'request_id': 'req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:07.415426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32c6c982771442094ed2a8bb10c20f9', 'request_id': 'req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:07.423696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32c6c982771442094ed2a8bb10c20f9', 'request_id': 'req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:07.437637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] The token cache is being invalidate because project e32c6c982771442094ed2a8bb10c20f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:07.438100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:07.439513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-93e6c863-9ac3-41c0-aaa3-24ee404e5f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:07.442423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1302/2621] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:07 2022] DELETE /identity/v3/projects/e32c6c982771442094ed2a8bb10c20f9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:07.447865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.448219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.448595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.471762 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:07.473010 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:07.517739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:07.541595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1320/2622] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:07.551112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.551336 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.551604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.572047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:07.573424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:07.582300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1303/2623] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:07.586711 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.597671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3a51-5e16-45e6-a8a1-df03fc30dbd7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.602640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.603440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.603753 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.604043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.604794 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:07.605105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.606731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.619524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1321/2624] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:07.623793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.635316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e5a07-44a7-41fe-abfc-aecd2f67afd1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.639696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.640493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.640775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.641051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.641751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.643940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.672274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1304/2625] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:07 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:07.676870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.687194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee577b-e970-4d25-866e-9561d86637bb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.746881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.747695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.748152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.748527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.749370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.751383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.781318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1322/2626] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:07 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:07.785439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.796241 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfa7c3-6055-4d98-8df2-fcc1bc467a99 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.806793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.808361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.809471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.810002 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.811046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.813557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.827402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1305/2627] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:07.832604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.850017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb9a1-251d-46f5-a69a-8c6f3d2f4978 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.855425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05609760-77c2-45de-b479-15263ab77155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.856234 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05609760-77c2-45de-b479-15263ab77155 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.856520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05609760-77c2-45de-b479-15263ab77155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.856800 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05609760-77c2-45de-b479-15263ab77155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.857536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05609760-77c2-45de-b479-15263ab77155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.859265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05609760-77c2-45de-b479-15263ab77155 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.875652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1323/2628] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:07.876774 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:07.887264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39531-ada3-49db-8bf3-ea6f9f2050b9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:07.892397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:07.893374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.893636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.893919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] PATH_INFO: `/v3/projects/99f7125f22474bd99f579794c27e763b/users/a320a2b1878640c5811e4a1104e20593/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.921515 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f7125f22474bd99f579794c27e763b, user_id=a320a2b1878640c5811e4a1104e20593, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:07.924177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:07.937592 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1306/2629] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:07 2022] PUT /identity/v3/projects/99f7125f22474bd99f579794c27e763b/users/a320a2b1878640c5811e4a1104e20593/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:07.952901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:07.953297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:07.953866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:07.989319 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] MFA Rules not processed for user `a320a2b1878640c5811e4a1104e20593`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:07.990621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:08.061567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1324/2630] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:08.065934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.130413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dd7e2-879f-4328-95b4-a6a48f8be80f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.135393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.136091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.136382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.136650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.137416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.139680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.155588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:08.178888 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1307/2631] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:08 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:08.183086 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.194747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765375-d658-4a7c-b8b6-85d69de59ca2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.230718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:08.257813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.258545 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.258791 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.259075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.260484 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.262736 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.286467 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1325/2632] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:08 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:08.290925 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.302407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8570-4906-4258-a06a-3b43435b773d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.307300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.308016 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.308304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.308585 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.309324 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.310938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.322178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1308/2633] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:08.326542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.338254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564a13-960f-4141-964c-15b8e94c6d7c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.344450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.349385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.349850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.350279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] PATH_INFO: `/v3/projects/367e196323c2456e91f0fd3942f73efd/users/b8c6bfb20ecb4792b32e2470f982681b/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.369594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367e196323c2456e91f0fd3942f73efd, user_id=b8c6bfb20ecb4792b32e2470f982681b, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.373031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.390766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1326/2634] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:08 2022] PUT /identity/v3/projects/367e196323c2456e91f0fd3942f73efd/users/b8c6bfb20ecb4792b32e2470f982681b/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:08.394954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.405594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643d886-d41a-4907-88cb-df9d205d193e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.472884 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa56d-71c4-49a8-9e56-1f3149d39d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.473699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa56d-71c4-49a8-9e56-1f3149d39d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.474124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa56d-71c4-49a8-9e56-1f3149d39d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.474443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa56d-71c4-49a8-9e56-1f3149d39d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.475182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfa56d-71c4-49a8-9e56-1f3149d39d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.477053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfa56d-71c4-49a8-9e56-1f3149d39d88 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.493451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1309/2635] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:08.498012 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.510457 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb8ef8-cafe-4a31-b04a-7c7d4ba44b24 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.515852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.516786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.517568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.517568 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] PATH_INFO: `/v3/projects/367e196323c2456e91f0fd3942f73efd/users/b8c6bfb20ecb4792b32e2470f982681b/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.520002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] RBAC: Authorizing `identity:create_grant(project_id=367e196323c2456e91f0fd3942f73efd, user_id=b8c6bfb20ecb4792b32e2470f982681b, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.522741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.536272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1327/2636] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:08 2022] PUT /identity/v3/projects/367e196323c2456e91f0fd3942f73efd/users/b8c6bfb20ecb4792b32e2470f982681b/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:08.547451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.547932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.548571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.551479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.553945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:08.586828 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] MFA Rules not processed for user `b8c6bfb20ecb4792b32e2470f982681b`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:08.587995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:08.636515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf343d-75d7-4b0a-9bf9-75b05805194c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.642874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.644837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.645129 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.645516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] PATH_INFO: `/v3/users/37f8b3b382ae4ffd87cc743787754225` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.647373 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f8b3b382ae4ffd87cc743787754225)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.650035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.664089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1310/2637] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:08.677575 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.679571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:08.709744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f8b3b382ae4ffd87cc743787754225'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:08.717727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f8b3b382ae4ffd87cc743787754225'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:08.730617 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f8b3b382ae4ffd87cc743787754225'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:08.731313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f8b3b382ae4ffd87cc743787754225'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:08.738451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f8b3b382ae4ffd87cc743787754225'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:08.744596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1328/2638] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:08 2022] DELETE /identity/v3/users/37f8b3b382ae4ffd87cc743787754225 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:08.752293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461096aa-b6f0-4b02-8891-dd26b4166596 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:08.771546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:08.819663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:08.820616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:08.820907 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:08.821330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:08.823796 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:08.904995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:08.906218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:08.917688 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1311/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:08.951986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:08.954785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:08.980773 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:09.029793 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:09.031325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:09.043599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cde2e-1a88-423e-8a4e-48193b90443c service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:09.048486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:09.049145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.049457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.050265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.053231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:09.074720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cf9e5-ee9f-41c7-99fc-b050ec1fb5df admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:09.079919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:09.081369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.081686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.081939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] PATH_INFO: `/v3/projects/554bec8699024b64a07edd629e25616c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.083226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=554bec8699024b64a07edd629e25616c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:09.093771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:09.132423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:09.134018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:09.145080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1312/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:43:09.149537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554bec8699024b64a07edd629e25616c', 'request_id': 'req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.158587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554bec8699024b64a07edd629e25616c', 'request_id': 'req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.165423 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554bec8699024b64a07edd629e25616c', 'request_id': 'req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.178219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] The token cache is being invalidate because project 554bec8699024b64a07edd629e25616c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:09.178531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.179204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.180937 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1329/2641] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:08 2022] DELETE /identity/v3/projects/554bec8699024b64a07edd629e25616c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:09.185156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:09.197157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6961ac-e20e-47d5-b3cb-7f7f53db07ca service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:09.269391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:09.270289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.270648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.270880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] PATH_INFO: `/v3/users/1e1ad3bd001c468195976f4b5007b5f1` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.272280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1ad3bd001c468195976f4b5007b5f1)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:09.274287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:09.287780 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:09.339107 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1ad3bd001c468195976f4b5007b5f1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.347974 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1ad3bd001c468195976f4b5007b5f1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.361916 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1ad3bd001c468195976f4b5007b5f1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.363009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1ad3bd001c468195976f4b5007b5f1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.374521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20d17af2-0caa-4cc8-8614-f0917031cd7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1ad3bd001c468195976f4b5007b5f1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.382939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1313/2642] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:09 2022] DELETE /identity/v3/users/1e1ad3bd001c468195976f4b5007b5f1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:09.570360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:09.572445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:09.596874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cb8e1-ff26-4b2f-a98e-dd77f42fb99c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:09.657206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:09.658935 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.659231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.659532 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] PATH_INFO: `/v3/projects/c7fd97b22b6145bca6a27caaecfc81f4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.660835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fd97b22b6145bca6a27caaecfc81f4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:09.662810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:09.708336 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:09.715514 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fd97b22b6145bca6a27caaecfc81f4', 'request_id': 'req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.724356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fd97b22b6145bca6a27caaecfc81f4', 'request_id': 'req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.730155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fd97b22b6145bca6a27caaecfc81f4', 'request_id': 'req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.741735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] The token cache is being invalidate because project c7fd97b22b6145bca6a27caaecfc81f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:09.742038 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.742689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1dfb7f17-ebf1-4396-ac6f-b70e6bdbf604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:09.744370 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1330/2643] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:09 2022] DELETE /identity/v3/projects/c7fd97b22b6145bca6a27caaecfc81f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:09.749945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.750191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.750508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.769640 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:09.770848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:09.840604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1314/2644] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:09.849284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.849866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.850485 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.874428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:09.876099 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:09.887413 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1331/2645] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:09.892094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:09.902274 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002e51-fd8d-488c-aac6-14fe0be0fd3a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:09.906963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:09.907674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.907937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.908214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.908942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:09.909250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:09.910864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:09.923294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1315/2646] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:09.928142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:09.938776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9661-e85e-49d1-944f-4a3c3ce16b8e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:09.945389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:09.946354 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:09.946719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:09.947157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:09.948154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:09.950699 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:09.982482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1332/2647] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:09 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:09.986633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:09.997374 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd903e3b-1586-4d0a-aad1-93353e19fab0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.058287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.058980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.059269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.059554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.060288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.062271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.082562 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1316/2648] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:09 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:10.087887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.100631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4bc75-5547-4a79-b9a5-cda295b0a5d7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.105590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.106271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.106553 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.106827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.107601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.109349 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.120960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1333/2649] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:10.122939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.124739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.124960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:10.133813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:10.137329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b13c8-c6f4-4370-9cf7-5115ea2a4783 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.139145 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dec5c-8579-48eb-a224-b62a9c2f0714 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.143560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.144863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.145341 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.145785 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.145973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.146664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.146949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.147264 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.147751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] PATH_INFO: `/v3/users/1dcfad8981ba42aeae5601df2d69d30f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.148517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.149551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dcfad8981ba42aeae5601df2d69d30f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.151611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.160362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1334/2650] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:10.164621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.178752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29b65-84f4-4ae4-8e5d-0a82e46b8be8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.184154 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3999c-bc4a-4f04-bccb-99a731a405e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.185186 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3999c-bc4a-4f04-bccb-99a731a405e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.185474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3999c-bc4a-4f04-bccb-99a731a405e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.185808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3999c-bc4a-4f04-bccb-99a731a405e0 admin admin] PATH_INFO: `/v3/projects/24e2f391854a4128839cd5f18363e78f/users/157315bd42284b21b9b6920550743f5d/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.203166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3999c-bc4a-4f04-bccb-99a731a405e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e2f391854a4128839cd5f18363e78f, user_id=157315bd42284b21b9b6920550743f5d, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.206493 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3999c-bc4a-4f04-bccb-99a731a405e0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.210653 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dcfad8981ba42aeae5601df2d69d30f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:10.219969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dcfad8981ba42aeae5601df2d69d30f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:10.227936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1335/2651] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:10 2022] PUT /identity/v3/projects/24e2f391854a4128839cd5f18363e78f/users/157315bd42284b21b9b6920550743f5d/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:10.234106 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dcfad8981ba42aeae5601df2d69d30f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:10.234973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dcfad8981ba42aeae5601df2d69d30f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:10.238601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.238901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.239180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.246787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ece0d895-cde1-4593-8302-a2382e34d377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dcfad8981ba42aeae5601df2d69d30f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:10.256123 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1317/2652] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:10 2022] DELETE /identity/v3/users/1dcfad8981ba42aeae5601df2d69d30f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:10.261841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.262127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.262402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.269447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] MFA Rules not processed for user `157315bd42284b21b9b6920550743f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:10.270769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:10.282785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:10.284229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:10.350267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1318/2653] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:10.357924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1336/2654] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:10.360213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.360452 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.361660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:10.362241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:10.375829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05457a-9adf-43f5-9783-e86d02879e2d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.382076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.383125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.384238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.384238 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.384776 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.387337 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.420136 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:10.422705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1319/2655] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:10 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:10.427139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.434117 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a1257-9f32-4922-a96a-6fd4bdd6eeb4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.504922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.505745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.506016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.506492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.513068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:10.520923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c5c9-df5b-44b2-9258-8567837a620d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.533355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.534632 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.535019 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.535299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.536584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.538675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.568513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1320/2656] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:10 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:10.570012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.584355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1e87-fdcc-4654-9f59-769de28bf4a8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.591468 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.592169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.592455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.592732 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.592956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.593457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.594486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.595051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.609281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1337/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:10.609943 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1321/2658] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:10.614340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.625216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b586f3-6dbf-49d0-ab6e-e98568bea7c4 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.630990 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.631835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.632114 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.632922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] PATH_INFO: `/v3/projects/471188f898e3481399d57e0df627e364/users/f379f1652d4f4a0bbe68afa999232a48/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.650422 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471188f898e3481399d57e0df627e364, user_id=f379f1652d4f4a0bbe68afa999232a48, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.652956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.669482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1338/2659] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:10 2022] PUT /identity/v3/projects/471188f898e3481399d57e0df627e364/users/f379f1652d4f4a0bbe68afa999232a48/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:10.673342 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.686081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c2ae-8dfb-478d-b2aa-b27f677cf84f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.794291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83d090-8cb4-4db1-b93e-07230a6643ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.794993 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d090-8cb4-4db1-b93e-07230a6643ef admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.795277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d090-8cb4-4db1-b93e-07230a6643ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.795556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d090-8cb4-4db1-b93e-07230a6643ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.796334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83d090-8cb4-4db1-b93e-07230a6643ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.797945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83d090-8cb4-4db1-b93e-07230a6643ef admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.825191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1322/2660] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:10.831674 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:10.845900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2f3f1-c8b5-4028-9549-6ac2276d7773 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:10.852837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:10.853750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.854047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.854327 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] PATH_INFO: `/v3/projects/471188f898e3481399d57e0df627e364/users/f379f1652d4f4a0bbe68afa999232a48/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.856978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471188f898e3481399d57e0df627e364, user_id=f379f1652d4f4a0bbe68afa999232a48, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:10.859888 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:10.874627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1339/2661] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:10 2022] PUT /identity/v3/projects/471188f898e3481399d57e0df627e364/users/f379f1652d4f4a0bbe68afa999232a48/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:10.886656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:10.886941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:10.887221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:10.921382 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] MFA Rules not processed for user `f379f1652d4f4a0bbe68afa999232a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:10.922674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:10.999413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1323/2662] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:11.013085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.015359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.078593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d86ef-edc8-49a5-947c-5d1d4c0aa413 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.083520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c4d3-6012-4ba8-b8b7-b16d82ae399e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.084308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c4d3-6012-4ba8-b8b7-b16d82ae399e service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.084594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c4d3-6012-4ba8-b8b7-b16d82ae399e service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.084936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c4d3-6012-4ba8-b8b7-b16d82ae399e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.095318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c4d3-6012-4ba8-b8b7-b16d82ae399e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.097196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c4d3-6012-4ba8-b8b7-b16d82ae399e service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.108377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1340/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:11.294819 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.296639 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.383073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:11.390763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4679c-ffbb-400c-b6fc-49fa629ff43b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.396368 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.397547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.397702 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.397936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] PATH_INFO: `/v3/projects/590742f1aa564dcd84f324dff912b5b2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.399290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] RBAC: Authorizing `identity:delete_project(project_id=590742f1aa564dcd84f324dff912b5b2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.401474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.459204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590742f1aa564dcd84f324dff912b5b2', 'request_id': 'req-79d8444f-3e1a-47ae-b861-0dfd3acb465e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.468218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590742f1aa564dcd84f324dff912b5b2', 'request_id': 'req-79d8444f-3e1a-47ae-b861-0dfd3acb465e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.477840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590742f1aa564dcd84f324dff912b5b2', 'request_id': 'req-79d8444f-3e1a-47ae-b861-0dfd3acb465e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.499643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] The token cache is being invalidate because project 590742f1aa564dcd84f324dff912b5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:11.500243 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.502075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.505474 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1324/2664] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:11 2022] DELETE /identity/v3/projects/590742f1aa564dcd84f324dff912b5b2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:11.513231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf87a-9a89-49dd-a046-a52111fe9849 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.513529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf87a-9a89-49dd-a046-a52111fe9849 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.513741 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf87a-9a89-49dd-a046-a52111fe9849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.540865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-11cbf87a-9a89-49dd-a046-a52111fe9849 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:11.541064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.542219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-11cbf87a-9a89-49dd-a046-a52111fe9849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.542360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.553926 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:11.615678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8444f-3e1a-47ae-b861-0dfd3acb465e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.617229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1341/2665] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:11.620962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.622171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.622681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.623142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] PATH_INFO: `/v3/users/157315bd42284b21b9b6920550743f5d` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.625029 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157315bd42284b21b9b6920550743f5d)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.625222 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.625458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.625660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.627649 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.645118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:11.646400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.655071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1342/2666] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:11.660403 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.669745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb2fa-31dd-4d00-95be-2782e42eb8f9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.675243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.675993 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.676286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.676569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.677301 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:11.677609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.679229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.683751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157315bd42284b21b9b6920550743f5d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.691705 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1343/2667] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 09:43:11.692211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157315bd42284b21b9b6920550743f5d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.695996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.705970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0e5ef-4cfa-4302-b7e6-54f20aea35a9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.708120 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157315bd42284b21b9b6920550743f5d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.708807 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157315bd42284b21b9b6920550743f5d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.710945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.711643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.711965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.712246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.712939 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.714828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.717945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-53af086d-b362-4763-8c2b-13e6a33dc718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157315bd42284b21b9b6920550743f5d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:11.725697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1325/2668] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:11 2022] DELETE /identity/v3/users/157315bd42284b21b9b6920550743f5d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:11.730139 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.730432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.730709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.740912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:11.749224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1344/2669] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:11 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:11.750664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.753539 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.755885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:11.757763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.829611 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1326/2670] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:11.834454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cac6b-7131-4d7d-9582-191831610d72 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.839551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.840316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.840647 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.840887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.841213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.841966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.842509 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:11.844098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.870571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1345/2671] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:11 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:11.876065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.891903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473160e4-e17a-4394-81dc-2f66ab1d1d03 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.897646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.898332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.898616 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.898894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.899660 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.901291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.910201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b6a4-8d5d-4469-ac02-dbb59294d30b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.913332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1346/2672] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:11.914051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.914711 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.914995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.915271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.918023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.925803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.927512 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.928589 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a644e-1bdf-492a-9f44-15d53c0d1807 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.934619 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119a034-e4c3-446d-93dd-9a39ebcb0b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.935430 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119a034-e4c3-446d-93dd-9a39ebcb0b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.935803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119a034-e4c3-446d-93dd-9a39ebcb0b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.936219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119a034-e4c3-446d-93dd-9a39ebcb0b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:11.937054 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119a034-e4c3-446d-93dd-9a39ebcb0b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:11.938869 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119a034-e4c3-446d-93dd-9a39ebcb0b41 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:11.941173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1327/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:11.953843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1347/2674] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:11.958452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:11.970590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2dcff-5c8b-419f-8d69-739b53deeea2 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:11.976539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:11.977963 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:11.978280 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:11.978768 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] PATH_INFO: `/v3/projects/fc06969b019344a49be7e062f765d823/users/f91de36eecb7403884b7262eccd89c78/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:12.018236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc06969b019344a49be7e062f765d823, user_id=f91de36eecb7403884b7262eccd89c78, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:12.022156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:12.039743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1328/2675] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:11 2022] PUT /identity/v3/projects/fc06969b019344a49be7e062f765d823/users/f91de36eecb7403884b7262eccd89c78/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:12.053622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:12.053919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:12.054215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:12.089536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] MFA Rules not processed for user `f91de36eecb7403884b7262eccd89c78`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:12.091082 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:12.152591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:12.197379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1348/2676] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:12.211112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:12.213427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:12.265600 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:12.268788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:12.311240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54fc30-ffb5-4bfc-b2a0-94cf980f1888 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:12.315885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:12.316556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:12.316843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:12.317178 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:12.328528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:12.330405 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:12.343389 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1329/2677] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:12.363254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f0f7e-f33b-4590-856f-9e4b3fa7bb7f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:12.368383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:12.369356 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:12.369680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:12.370017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] PATH_INFO: `/v3/projects/24e2f391854a4128839cd5f18363e78f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:12.371369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e2f391854a4128839cd5f18363e78f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:12.373675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:12.429230 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e2f391854a4128839cd5f18363e78f', 'request_id': 'req-a08c9c65-7d8f-46f2-9846-059f410f3647'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.437768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e2f391854a4128839cd5f18363e78f', 'request_id': 'req-a08c9c65-7d8f-46f2-9846-059f410f3647'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.444919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e2f391854a4128839cd5f18363e78f', 'request_id': 'req-a08c9c65-7d8f-46f2-9846-059f410f3647'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.460624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] The token cache is being invalidate because project 24e2f391854a4128839cd5f18363e78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:12.460788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.461396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.463254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1349/2678] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:12 2022] DELETE /identity/v3/projects/24e2f391854a4128839cd5f18363e78f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:12.467348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:12.480306 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a53e-703e-4f1d-b6f1-2565206409d5 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:12.519110 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:12.573418 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:12.574730 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:12.575219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:12.576572 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] PATH_INFO: `/v3/users/f379f1652d4f4a0bbe68afa999232a48` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:12.578340 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f379f1652d4f4a0bbe68afa999232a48)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:12.580771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:12.677751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f379f1652d4f4a0bbe68afa999232a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.693143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f379f1652d4f4a0bbe68afa999232a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.716011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f379f1652d4f4a0bbe68afa999232a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.716645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f379f1652d4f4a0bbe68afa999232a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.725316 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-28e82538-e959-43df-9545-538df86c1c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f379f1652d4f4a0bbe68afa999232a48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:12.733813 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1330/2679] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:12 2022] DELETE /identity/v3/users/f379f1652d4f4a0bbe68afa999232a48 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:13.084204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.086372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:13.101890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c9c65-7d8f-46f2-9846-059f410f3647 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.165081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.166011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.166292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.166564 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] PATH_INFO: `/v3/projects/471188f898e3481399d57e0df627e364` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.167767 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=471188f898e3481399d57e0df627e364)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.169692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.172240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:13.224664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471188f898e3481399d57e0df627e364', 'request_id': 'req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:13.232432 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471188f898e3481399d57e0df627e364', 'request_id': 'req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:13.238084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471188f898e3481399d57e0df627e364', 'request_id': 'req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:13.249515 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] The token cache is being invalidate because project 471188f898e3481399d57e0df627e364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:13.249853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:13.250536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe0aef5e-69fd-4b8d-8975-60beda9dfe46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:13.253096 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1350/2680] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:13 2022] DELETE /identity/v3/projects/471188f898e3481399d57e0df627e364 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:13.258867 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.259154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.260593 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.282202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:13.284279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:13.349053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1331/2681] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:13.357431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.357774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.357997 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.377703 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:13.378916 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:13.386894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1351/2682] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:13.391635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.401615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbe978-af4b-454f-acac-47e31257733c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.406276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.406934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.407222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.407502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.408404 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:13.409221 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.410814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.424315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1332/2683] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:13.429192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.438584 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d038bb-61bf-44c8-9953-9ee8ff76d0d5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.443472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.444169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.444507 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.444817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.445505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.447492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.474348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1352/2684] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:13 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:13.478586 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.489217 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466aed5-32b0-4edf-bec5-aecf02febc1c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.523017 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:13.553704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.554376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.554661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.554945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.555643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.557584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.582899 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1333/2685] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:13 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:13.584115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.594569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb7983-8d50-46a6-aa0c-3ef6f0bd5a96 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.599907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.600570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.600853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.601128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.601859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.603458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.616176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1353/2686] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:13.620752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.631053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471dff-7b1d-48f1-9bc0-b057ab2fa1ff admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.635999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f742498-2e4e-44f6-bd92-39e48a27f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.636697 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f742498-2e4e-44f6-bd92-39e48a27f26b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.636973 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f742498-2e4e-44f6-bd92-39e48a27f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.637272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f742498-2e4e-44f6-bd92-39e48a27f26b admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.638053 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f742498-2e4e-44f6-bd92-39e48a27f26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.640032 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f742498-2e4e-44f6-bd92-39e48a27f26b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.651355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1334/2687] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:13.657823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.671231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8e068-76fa-4c28-86d9-2a8bb2c33a4d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.676897 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.677824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.678201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.678472 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] PATH_INFO: `/v3/projects/aea2f34ff5b54224975162c71f974531/users/79132024fdcb4a8eabdeee0c36cb72fa/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.694267 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea2f34ff5b54224975162c71f974531, user_id=79132024fdcb4a8eabdeee0c36cb72fa, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.697365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.713211 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1354/2688] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:13 2022] PUT /identity/v3/projects/aea2f34ff5b54224975162c71f974531/users/79132024fdcb4a8eabdeee0c36cb72fa/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:13.725689 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.726054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.726419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.752606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] MFA Rules not processed for user `79132024fdcb4a8eabdeee0c36cb72fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:13.753838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:13.821007 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1335/2689] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:13.838046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:13.840184 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:13.926923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d63f-2380-43f5-a1b9-0bf1841de42f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:13.929891 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131524e-8d80-4803-823a-e8cc481c1445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:13.930557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131524e-8d80-4803-823a-e8cc481c1445 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:13.930844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131524e-8d80-4803-823a-e8cc481c1445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:13.931121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131524e-8d80-4803-823a-e8cc481c1445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:13.942412 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131524e-8d80-4803-823a-e8cc481c1445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:13.944111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131524e-8d80-4803-823a-e8cc481c1445 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:13.957324 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1355/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:13.978214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:14.051388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6469-afe1-4ba7-a46f-e20e5406c170 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:14.057176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:14.058165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.058545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.058823 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] PATH_INFO: `/v3/users/79132024fdcb4a8eabdeee0c36cb72fa` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.060379 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79132024fdcb4a8eabdeee0c36cb72fa)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:14.062740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:14.125554 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:14.129344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79132024fdcb4a8eabdeee0c36cb72fa'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.142262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79132024fdcb4a8eabdeee0c36cb72fa'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.160037 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79132024fdcb4a8eabdeee0c36cb72fa'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.160964 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79132024fdcb4a8eabdeee0c36cb72fa'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.168989 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79132024fdcb4a8eabdeee0c36cb72fa'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.175590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1336/2691] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:13 2022] DELETE /identity/v3/users/79132024fdcb4a8eabdeee0c36cb72fa => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:14.180229 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.180780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.180780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.198415 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:14.199643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:14.229207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:14.268771 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1356/2692] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:14.278588 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:14.280824 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:14.340346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0c705-424a-4997-afaf-d64d144bfc7b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:14.344025 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ad441-fcb9-4217-a319-316adc5f812f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:14.344760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad441-fcb9-4217-a319-316adc5f812f service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.346170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad441-fcb9-4217-a319-316adc5f812f service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.346170 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad441-fcb9-4217-a319-316adc5f812f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.355064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad441-fcb9-4217-a319-316adc5f812f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:14.356854 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad441-fcb9-4217-a319-316adc5f812f service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:14.367752 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1337/2693] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:14.672900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:14.675876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:14.691827 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6fa69-f901-486e-9ba7-c65c3b94e637 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:14.695244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:14.696157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.696444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.696725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] PATH_INFO: `/v3/projects/aea2f34ff5b54224975162c71f974531` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.698052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea2f34ff5b54224975162c71f974531)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:14.699986 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:14.748274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea2f34ff5b54224975162c71f974531', 'request_id': 'req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.757955 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea2f34ff5b54224975162c71f974531', 'request_id': 'req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.765168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea2f34ff5b54224975162c71f974531', 'request_id': 'req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.778246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] The token cache is being invalidate because project aea2f34ff5b54224975162c71f974531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:14.778523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.779225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cbc52b4f-d0c4-4152-83ed-e6c7c6878add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:14.780818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1357/2694] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:14 2022] DELETE /identity/v3/projects/aea2f34ff5b54224975162c71f974531 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:14.786169 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.786750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.786857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.807494 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:14.808749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:14.871487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1338/2695] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:14.880933 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.881225 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.881508 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.901046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:14.902273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:14.910912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1358/2696] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:14.915502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:14.932666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c2a91-28fc-45a7-93dc-456888810cec None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:14.939119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:14.940615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.941075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.941456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.942413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:14.942770 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:14.944786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:14.964686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1339/2697] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:14.966440 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:14.975951 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1c3b-f36a-4219-8936-3f90a37e5a68 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:14.981063 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:14.981766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:14.982179 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:14.985987 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:14.987575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:14.991540 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.026747 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1359/2698] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:14 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:15.028402 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.044873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90d484-480b-4d8a-bc3e-96a46e863b6b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:15.101684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:15.114923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:15.115606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.115920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.116202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.116896 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:15.118835 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.145759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1340/2699] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:15 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:15.150159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.168181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a394e1-0ac8-48dd-a080-b67affbd8e3e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:15.174947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:15.175682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.176137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.176601 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.177441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:15.179649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.192512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1360/2700] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:15.197183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.210756 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709137f4-f31d-47c0-8d34-9036b41ffc0d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:15.220696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975223b-3d0b-4b28-b8f1-a7bcfcebc14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:15.222175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975223b-3d0b-4b28-b8f1-a7bcfcebc14e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.222481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975223b-3d0b-4b28-b8f1-a7bcfcebc14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.222753 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975223b-3d0b-4b28-b8f1-a7bcfcebc14e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.223519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975223b-3d0b-4b28-b8f1-a7bcfcebc14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:15.228942 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975223b-3d0b-4b28-b8f1-a7bcfcebc14e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.240610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1341/2701] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:15.245586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.256284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b9947-7d83-427c-b9ee-f38aaa9f9b02 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:15.261641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:15.262735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.263041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.263609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] PATH_INFO: `/v3/projects/95752f4d785c47129236577decbd1c43/users/d4fa0607410441ef8d639eead7dc6d91/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.280080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95752f4d785c47129236577decbd1c43, user_id=d4fa0607410441ef8d639eead7dc6d91, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:15.283529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.300060 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1361/2702] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:15 2022] PUT /identity/v3/projects/95752f4d785c47129236577decbd1c43/users/d4fa0607410441ef8d639eead7dc6d91/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:15.311969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.312269 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.312547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.342699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] MFA Rules not processed for user `d4fa0607410441ef8d639eead7dc6d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:15.343953 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:15.412188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1342/2703] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:15.423836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.426095 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:15.507643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89630467-8e8e-4a4b-a7b0-2a24a302fff1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:15.511956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd9cd5-efca-4632-b56d-372c3c5a059e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6736109f3549eb85021ce2d6a23436', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:15.512651 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd9cd5-efca-4632-b56d-372c3c5a059e service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.512944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd9cd5-efca-4632-b56d-372c3c5a059e service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.513250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd9cd5-efca-4632-b56d-372c3c5a059e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.520057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:15.526127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd9cd5-efca-4632-b56d-372c3c5a059e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:15.528037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd9cd5-efca-4632-b56d-372c3c5a059e service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.539048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1362/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:15.623276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.625064 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:15.702903 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bba54f-cd14-4055-bfb8-81bcdbb4a1d4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:15.708345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:15.709118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.709398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.709778 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] PATH_INFO: `/v3/users/a320a2b1878640c5811e4a1104e20593` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.710917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a320a2b1878640c5811e4a1104e20593)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:15.712871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:15.765204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a320a2b1878640c5811e4a1104e20593'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:15.774071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a320a2b1878640c5811e4a1104e20593'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:15.779537 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:15.788837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a320a2b1878640c5811e4a1104e20593'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:15.789922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a320a2b1878640c5811e4a1104e20593'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:15.797428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a320a2b1878640c5811e4a1104e20593'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:15.805429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1343/2705] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:15 2022] DELETE /identity/v3/users/a320a2b1878640c5811e4a1104e20593 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:15.810606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:15.811053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:15.811379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:15.836055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:15.837722 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:15.915441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1363/2706] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:15.927595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:15.932738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:16.003849 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc7492-c902-47f2-9b95-101081e2c2f6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:16.008020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:16.008887 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:16.009166 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:16.009504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:16.021424 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:16.023051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:16.036785 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1344/2707] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:16.380524 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:16.382131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:16.397474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7650d3-0586-4a3b-a8c8-98d827ff044f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:16.405959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:16.407429 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:16.408249 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:16.408638 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] PATH_INFO: `/v3/projects/99f7125f22474bd99f579794c27e763b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:16.410569 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f7125f22474bd99f579794c27e763b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:16.413451 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:16.479263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f7125f22474bd99f579794c27e763b', 'request_id': 'req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.489352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f7125f22474bd99f579794c27e763b', 'request_id': 'req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.495884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f7125f22474bd99f579794c27e763b', 'request_id': 'req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.511389 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] The token cache is being invalidate because project 99f7125f22474bd99f579794c27e763b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:16.511686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.512405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.514295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1364/2708] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:16 2022] DELETE /identity/v3/projects/99f7125f22474bd99f579794c27e763b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:16.520635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:16.532547 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7bd41-8d55-4c1f-b051-7aec9501729d service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:16.613438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:16.614584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:16.615008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:16.615416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] PATH_INFO: `/v3/users/b8c6bfb20ecb4792b32e2470f982681b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:16.617098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c6bfb20ecb4792b32e2470f982681b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:16.619634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:16.680488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c6bfb20ecb4792b32e2470f982681b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.689253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c6bfb20ecb4792b32e2470f982681b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.704310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c6bfb20ecb4792b32e2470f982681b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.705018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c6bfb20ecb4792b32e2470f982681b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.712000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ce539adc-a6d0-4192-adff-96364588e8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c6bfb20ecb4792b32e2470f982681b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:16.714079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:16.718673 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1345/2709] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:16 2022] DELETE /identity/v3/users/b8c6bfb20ecb4792b32e2470f982681b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:17.061133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.063155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:17.077533 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e5ba8-8cd5-488d-adaa-89aa8efd3413 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.149902 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.150766 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.151062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.151331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] PATH_INFO: `/v3/projects/367e196323c2456e91f0fd3942f73efd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.152596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367e196323c2456e91f0fd3942f73efd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.154528 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.182709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:17.213201 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367e196323c2456e91f0fd3942f73efd', 'request_id': 'req-b631ef91-2a69-4e55-90a3-172580dd47a7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:17.222765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367e196323c2456e91f0fd3942f73efd', 'request_id': 'req-b631ef91-2a69-4e55-90a3-172580dd47a7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:17.228829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367e196323c2456e91f0fd3942f73efd', 'request_id': 'req-b631ef91-2a69-4e55-90a3-172580dd47a7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:17.240668 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] The token cache is being invalidate because project 367e196323c2456e91f0fd3942f73efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:17.240944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:17.241620 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b631ef91-2a69-4e55-90a3-172580dd47a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:17.243180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1365/2710] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:17 2022] DELETE /identity/v3/projects/367e196323c2456e91f0fd3942f73efd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:17.248164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.248672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.248792 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.269330 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:17.270536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:17.350203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1346/2711] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:17.358169 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.358460 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.358735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.377554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:17.378770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:17.386837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1366/2712] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:17.391528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.402310 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018851b-0187-4df3-beda-c7780db770c9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.409305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.411080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.411080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.411080 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.411412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:17.411645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.413380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.425441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1347/2713] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:17.429991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.439999 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd1f7b-b8d3-4a35-b68f-827b24bb2535 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.447194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.447744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.448042 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.448321 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.449035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.450973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.480587 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1367/2714] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:17 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:17.484936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.498443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d517cc-04db-4c5b-b7ca-33a321657061 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.579222 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.581082 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.581493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.581840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.582997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.585797 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.614618 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1348/2715] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:17 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:17.616113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.628174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2720a82-60d2-4b50-863a-a513d502b3a6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.633035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.633786 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.634254 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.634598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.635400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.637155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.648809 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1368/2716] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:17.652946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.663526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7323ee-b7f3-4cc5-9d02-330aa949ef78 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.670156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60466992-45d5-4188-87e5-4748b8947e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.670997 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466992-45d5-4188-87e5-4748b8947e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.671394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466992-45d5-4188-87e5-4748b8947e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.671809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466992-45d5-4188-87e5-4748b8947e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.672699 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60466992-45d5-4188-87e5-4748b8947e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.674787 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60466992-45d5-4188-87e5-4748b8947e14 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.688536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1349/2717] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:17.693556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.704831 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fe5db-ed0e-4528-9015-37a128b1338b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.715646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.716649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.716973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.717343 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] PATH_INFO: `/v3/projects/d849820d3e164de4ab516ccac6c12d17/users/6b6ae1835565430eb16ba1ff3758e472/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.736960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d849820d3e164de4ab516ccac6c12d17, user_id=6b6ae1835565430eb16ba1ff3758e472, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.739512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:17.755815 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1369/2718] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:17 2022] PUT /identity/v3/projects/d849820d3e164de4ab516ccac6c12d17/users/6b6ae1835565430eb16ba1ff3758e472/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:17.767287 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.768957 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.769566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.801089 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] MFA Rules not processed for user `6b6ae1835565430eb16ba1ff3758e472`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:17.802334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:17.868681 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:17.889651 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1350/2719] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:17.894682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:17.964991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b577fd8-add7-44d3-8d89-6ac42a23aa0a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:17.970017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:17.970687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:17.971002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:17.971863 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:17.972554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:17.974468 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.000984 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1370/2720] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:17 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:18.005175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:18.020687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cde4e9-54c6-4780-b43d-fe8af740f9a7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:18.093201 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:18.093885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.094175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.094451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.095143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:18.097676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.119219 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1351/2721] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:18 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:18.123140 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:18.137473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f20a-6501-470d-a06a-386b8b200171 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:18.144899 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:18.146036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.146492 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.147016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.147968 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:18.150070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.163745 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1371/2722] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:18.168432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:18.189163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2799-4490-44d4-b44e-b241c4c5cf99 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:18.194411 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:18.195313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.195599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.195908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] PATH_INFO: `/v3/projects/53a16686dc8d45e4a15f7665731d6c3e/users/5f3931d7876d406b863f6eb51a021759/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.212733 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a16686dc8d45e4a15f7665731d6c3e, user_id=5f3931d7876d406b863f6eb51a021759, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:18.215444 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.231636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1352/2723] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:18 2022] PUT /identity/v3/projects/53a16686dc8d45e4a15f7665731d6c3e/users/5f3931d7876d406b863f6eb51a021759/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:18.236634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:18.248079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5d0a-c921-4f48-927b-c41693e2f5be admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:18.262640 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:18.318378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece21bd0-c0e5-467c-b7e0-b6a910ded74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:18.319050 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21bd0-c0e5-467c-b7e0-b6a910ded74a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.319331 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21bd0-c0e5-467c-b7e0-b6a910ded74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.319604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece21bd0-c0e5-467c-b7e0-b6a910ded74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.320360 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece21bd0-c0e5-467c-b7e0-b6a910ded74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:18.321945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece21bd0-c0e5-467c-b7e0-b6a910ded74a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.332609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1372/2724] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:18.337187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:18.349536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898ec09-7daf-43a8-bcc0-f866af8ea4ec admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:18.355914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:18.357176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.357301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.357534 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] PATH_INFO: `/v3/projects/53a16686dc8d45e4a15f7665731d6c3e/users/5f3931d7876d406b863f6eb51a021759/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.359555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a16686dc8d45e4a15f7665731d6c3e, user_id=5f3931d7876d406b863f6eb51a021759, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:18.362458 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.373184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1353/2725] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:18 2022] PUT /identity/v3/projects/53a16686dc8d45e4a15f7665731d6c3e/users/5f3931d7876d406b863f6eb51a021759/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:18.385689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.386164 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.386469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.414603 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] MFA Rules not processed for user `5f3931d7876d406b863f6eb51a021759`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:18.416215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:18.489433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1373/2726] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:18.501124 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:18.504059 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:18.566435 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df003942-3c19-4ff5-b6e4-517d1a8fef1f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:18.571041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:18.571430 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:18.571604 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:18.571901 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:18.635545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:18.637074 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:18.647076 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1354/2727] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:43:21.236080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:21.246246 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb288-9d49-4063-bc9d-3c7d02256e0f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:21.249808 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960ebbf-f6ef-4ce5-baba-a3aff672dc20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:21.250449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ebbf-f6ef-4ce5-baba-a3aff672dc20 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:21.250732 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ebbf-f6ef-4ce5-baba-a3aff672dc20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:21.251008 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ebbf-f6ef-4ce5-baba-a3aff672dc20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:21.260092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ebbf-f6ef-4ce5-baba-a3aff672dc20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:21.261505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ebbf-f6ef-4ce5-baba-a3aff672dc20 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:21.273002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1374/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:22.652610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:22.654457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:22.660949 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:22.737098 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e5f0-f755-4608-84bd-c7c35257e603 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:22.742751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:22.743765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:22.744052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:22.744331 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] PATH_INFO: `/v3/users/f91de36eecb7403884b7262eccd89c78` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:22.745613 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91de36eecb7403884b7262eccd89c78)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:22.747615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:22.798657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91de36eecb7403884b7262eccd89c78'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:22.808679 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91de36eecb7403884b7262eccd89c78'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:22.822945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91de36eecb7403884b7262eccd89c78'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:22.824153 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91de36eecb7403884b7262eccd89c78'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:22.835229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91de36eecb7403884b7262eccd89c78'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:22.841348 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1355/2729] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:22 2022] DELETE /identity/v3/users/f91de36eecb7403884b7262eccd89c78 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:22.846447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:22.846996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:22.847118 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:22.865680 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:22.866972 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:22.944408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1375/2730] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:22.955909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:22.957514 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:23.023938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c15ba0-336c-437f-987e-2bdc8f923228 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.028420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef9b7-1b3c-4d88-9336-6bc0c70bb905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.029105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef9b7-1b3c-4d88-9336-6bc0c70bb905 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.029372 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef9b7-1b3c-4d88-9336-6bc0c70bb905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.029719 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef9b7-1b3c-4d88-9336-6bc0c70bb905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.040721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ef9b7-1b3c-4d88-9336-6bc0c70bb905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.042211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ef9b7-1b3c-4d88-9336-6bc0c70bb905 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.051929 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1356/2731] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:23.350141 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.351609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:23.364176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a8595-b8aa-4c6b-88f1-89436ad1537b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.369938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.370960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.371303 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.371563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] PATH_INFO: `/v3/projects/fc06969b019344a49be7e062f765d823` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.373059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc06969b019344a49be7e062f765d823)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.374974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.403792 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:23.428046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc06969b019344a49be7e062f765d823', 'request_id': 'req-6135d768-83c0-42fd-8e03-5ac2a25e1758'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:23.436734 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc06969b019344a49be7e062f765d823', 'request_id': 'req-6135d768-83c0-42fd-8e03-5ac2a25e1758'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:23.444643 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc06969b019344a49be7e062f765d823', 'request_id': 'req-6135d768-83c0-42fd-8e03-5ac2a25e1758'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:23.460453 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] The token cache is being invalidate because project fc06969b019344a49be7e062f765d823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:23.460746 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:23.461410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6135d768-83c0-42fd-8e03-5ac2a25e1758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:23.463035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1376/2732] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:23 2022] DELETE /identity/v3/projects/fc06969b019344a49be7e062f765d823 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:23.468420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.468749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.469151 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.491397 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:23.492741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:23.512832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:23.561351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1357/2733] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:23.569387 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.569726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.570065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.592138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:23.593358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:23.602057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1377/2734] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:23.606304 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.616389 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78631d95-fb9b-4da7-85ea-f7cf68fad0eb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.621721 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.622387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.622676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.622954 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.623704 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:23.624024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.625617 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.638044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1358/2735] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:23.643271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.652712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8f51b-2cc6-40e2-bb55-4b25a998ac3a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.657840 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.658502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.658782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.659057 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.659890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.661970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.692198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1378/2736] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:23 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:23.696628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.707549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08c6b-0a79-4d75-9f26-937f78c225ce admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.764048 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.764641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.764931 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.765205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.765882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.768472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.792937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1359/2737] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:23 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:23.797035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.807406 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c20eca-89ac-49d0-9a32-982f34ea0176 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.812110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.812776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.813058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.813334 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.814056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.816228 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.827145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1379/2738] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:23.832111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.843100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94442d0b-86c0-4997-b7ba-23d96200ba4f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.849033 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942ecd4-13c3-4831-9123-775eddc6e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.851630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ecd4-13c3-4831-9123-775eddc6e14b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.851630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ecd4-13c3-4831-9123-775eddc6e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.851630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ecd4-13c3-4831-9123-775eddc6e14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.852302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942ecd4-13c3-4831-9123-775eddc6e14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.854606 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942ecd4-13c3-4831-9123-775eddc6e14b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.869549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1360/2739] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:23.873796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:23.885770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bbec0-5bf6-42cf-8dce-bb41f2c4bae6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:23.891642 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:23.893534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.893857 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.894375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] PATH_INFO: `/v3/projects/fc16ad037e954656a405c4ebc2ccd9c2/users/05589f6be4c646aca4fbba4e2909f009/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.913357 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc16ad037e954656a405c4ebc2ccd9c2, user_id=05589f6be4c646aca4fbba4e2909f009, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:23.916206 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:23.934043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1380/2740] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:23 2022] PUT /identity/v3/projects/fc16ad037e954656a405c4ebc2ccd9c2/users/05589f6be4c646aca4fbba4e2909f009/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:23.942197 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa70e15-a745-455b-8e55-2dbabe6930af None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:23.942531 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa70e15-a745-455b-8e55-2dbabe6930af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:23.942975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa70e15-a745-455b-8e55-2dbabe6930af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:23.968926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0fa70e15-a745-455b-8e55-2dbabe6930af None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:23.970587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0fa70e15-a745-455b-8e55-2dbabe6930af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:24.044914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1361/2741] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:24.055558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:24.057411 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:24.130040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859cab-8f42-4d71-b30c-88933b2694f1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:24.134076 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:24.134744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:24.135062 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:24.135458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:24.147676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:24.149174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:24.159885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1381/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:28.702740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:28.703326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:28.703326 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:28.733634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] MFA Rules not processed for user `05589f6be4c646aca4fbba4e2909f009`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:28.734946 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:28.764005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:28.822271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1362/2743] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:28.831633 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:28.844291 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1698a51-6060-4811-be21-ec6b23ea9b7f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:28.850055 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:28.850728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:28.851084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:28.851362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:28.852142 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:28.854019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:28.883191 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1382/2744] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:28 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:28.889932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:28.901859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c528b1-9ad9-4063-acf8-aa974676ce5a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:28.963202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:28.963914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:28.964203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:28.964481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:28.965183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:28.967109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:28.989327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1363/2745] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:28 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:28.995247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:29.005272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c0355-2580-44bb-b17e-6c0441ed0b3d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:29.010135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:29.010848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:29.011131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:29.011405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:29.012379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:29.014109 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:29.028894 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1383/2746] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:29.034934 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:29.046215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66822c2-ac75-4372-8d4e-023946aae8b4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:29.051150 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:29.052100 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:29.052384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:29.052657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] PATH_INFO: `/v3/projects/b74e76058189428bb77778f8b252d6fc/users/0ec37bc992e64432a66c02fdd7a0d3cf/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:29.070804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74e76058189428bb77778f8b252d6fc, user_id=0ec37bc992e64432a66c02fdd7a0d3cf, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:29.074519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:29.094736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1364/2747] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:29 2022] PUT /identity/v3/projects/b74e76058189428bb77778f8b252d6fc/users/0ec37bc992e64432a66c02fdd7a0d3cf/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:29.098721 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:29.110615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3de4-52d1-4e78-9a40-d1f47c67fb5d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:29.130241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:29.183846 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:29.184531 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:29.184811 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:29.185087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:29.185817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:29.187417 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:29.198207 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1384/2748] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:43:29.202675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:29.214678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94728da-89ce-4a06-b0a2-58878f59e20f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:29.221069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43049d-e3ac-4845-914c-e6f216eb9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:29.221967 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43049d-e3ac-4845-914c-e6f216eb9dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:29.222259 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43049d-e3ac-4845-914c-e6f216eb9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:29.222540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43049d-e3ac-4845-914c-e6f216eb9dcd admin admin] PATH_INFO: `/v3/projects/b74e76058189428bb77778f8b252d6fc/users/0ec37bc992e64432a66c02fdd7a0d3cf/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:29.224629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43049d-e3ac-4845-914c-e6f216eb9dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74e76058189428bb77778f8b252d6fc, user_id=0ec37bc992e64432a66c02fdd7a0d3cf, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:29.227279 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43049d-e3ac-4845-914c-e6f216eb9dcd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:29.238856 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1365/2749] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:29 2022] PUT /identity/v3/projects/b74e76058189428bb77778f8b252d6fc/users/0ec37bc992e64432a66c02fdd7a0d3cf/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:32.380318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:32.382145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:32.401477 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa8201-903d-4283-a416-564986e11a52 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:32.561001 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:32.568550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:32.569006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:32.569743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] PATH_INFO: `/v3/users/d4fa0607410441ef8d639eead7dc6d91` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:32.572676 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fa0607410441ef8d639eead7dc6d91)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:32.577131 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:32.672351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fa0607410441ef8d639eead7dc6d91'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:32.682458 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fa0607410441ef8d639eead7dc6d91'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:32.699445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fa0607410441ef8d639eead7dc6d91'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:32.700690 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fa0607410441ef8d639eead7dc6d91'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:32.709672 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fa0607410441ef8d639eead7dc6d91'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:32.719828 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1385/2750] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:32 2022] DELETE /identity/v3/users/d4fa0607410441ef8d639eead7dc6d91 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:32.721541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:32.722041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:32.722175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:32.758442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:32.760355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:32.901549 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1366/2751] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:32.911807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:32.913338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:32.989034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:33.021683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10ca2-8248-455d-8f21-831ef0c7a017 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:33.027398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01255-4558-4293-a3da-8598ea8d98b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:33.028070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01255-4558-4293-a3da-8598ea8d98b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:33.028410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01255-4558-4293-a3da-8598ea8d98b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:33.028903 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01255-4558-4293-a3da-8598ea8d98b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:33.042820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01255-4558-4293-a3da-8598ea8d98b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:33.044597 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01255-4558-4293-a3da-8598ea8d98b6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:33.078956 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1386/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:33.636914 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:33.638391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:33.667545 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5766-fd30-4d78-91a3-2936e3e177db None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:33.704443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:33.704443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:33.704443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:33.704443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] PATH_INFO: `/v3/projects/95752f4d785c47129236577decbd1c43` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:33.708421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95752f4d785c47129236577decbd1c43)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:33.714069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:33.738146 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:33.887842 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95752f4d785c47129236577decbd1c43', 'request_id': 'req-6b15c49d-855b-45fc-baf8-a115f0ecdc77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:33.902213 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95752f4d785c47129236577decbd1c43', 'request_id': 'req-6b15c49d-855b-45fc-baf8-a115f0ecdc77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:33.910334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95752f4d785c47129236577decbd1c43', 'request_id': 'req-6b15c49d-855b-45fc-baf8-a115f0ecdc77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:33.928049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] The token cache is being invalidate because project 95752f4d785c47129236577decbd1c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:33.928521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:33.929318 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6b15c49d-855b-45fc-baf8-a115f0ecdc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:33.931763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1367/2753] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:33 2022] DELETE /identity/v3/projects/95752f4d785c47129236577decbd1c43 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:33.936119 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:33.936969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:33.937418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:33.966245 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:33.967803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:34.104726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1387/2754] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:34.106165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.106456 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.108344 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.148068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:34.149327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:34.175000 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1368/2755] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:34.178922 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.191666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce7f4d-244b-4b67-8009-c6e7dc3a55b5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.208911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.209929 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.210381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.210841 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.211823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:34.212408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.214108 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.245291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.248781 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1388/2756] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:34.262129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7677f-0d21-4042-99c4-282a7c9f14eb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.270109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcc28f-0b4c-4d14-9598-937a30abf700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.270984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcc28f-0b4c-4d14-9598-937a30abf700 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.271421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcc28f-0b4c-4d14-9598-937a30abf700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.272050 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcc28f-0b4c-4d14-9598-937a30abf700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.272927 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcc28f-0b4c-4d14-9598-937a30abf700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.275262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcc28f-0b4c-4d14-9598-937a30abf700 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.333001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1369/2757] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:34 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:34.337098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.355945 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766c40-c41c-487a-86a9-2862131a1121 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.473427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.473672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.473905 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.507313 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.508029 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.508312 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.508588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.509285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.511270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.518647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] MFA Rules not processed for user `0ec37bc992e64432a66c02fdd7a0d3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:34.521353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:34.540707 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1389/2758] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:34 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:34.541923 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.556790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513f80-befc-43c4-992a-a9081b044954 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.562113 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.562910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.563268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.563612 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.564548 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.566274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.584719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1390/2759] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:34.589128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.612860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3094a6-a6cf-4996-af81-b070b3bbe1f0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.624845 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.626043 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.626592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.628700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.629821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.632072 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.647815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1370/2760] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:34.651247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1391/2761] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:34.655457 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.661760 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.665931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:34.678922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b83f1-84f6-45eb-9d31-8d1b9f676031 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.685725 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.686631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.686911 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.687185 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] PATH_INFO: `/v3/projects/98bdaa297d2540f0a8ec94628b46024a/users/7bbd6047a4c84ca8a9222aafed38af5c/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.714314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:34.719239 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bdaa297d2540f0a8ec94628b46024a, user_id=7bbd6047a4c84ca8a9222aafed38af5c, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.722665 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.752530 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1371/2762] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:34 2022] PUT /identity/v3/projects/98bdaa297d2540f0a8ec94628b46024a/users/7bbd6047a4c84ca8a9222aafed38af5c/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:34.753612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:34.755353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:34.775407 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2969fa8-57a2-4dc5-8501-27209a7bddf9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.796388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:34.842771 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b080d0-82c2-4872-a390-1781495e9e4f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:34.849218 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.850109 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.850394 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.850666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] PATH_INFO: `/v3/users/6b6ae1835565430eb16ba1ff3758e472` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.852008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6ae1835565430eb16ba1ff3758e472)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.853961 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.862798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:34.863473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.863882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.864066 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.865973 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:34.930851 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6ae1835565430eb16ba1ff3758e472'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:34.940432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6ae1835565430eb16ba1ff3758e472'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:34.956521 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6ae1835565430eb16ba1ff3758e472'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:34.957303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6ae1835565430eb16ba1ff3758e472'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:34.958256 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:34.960421 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5ebf9-121b-410c-a24c-7f7c3a0f25e8 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:34.964230 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-450ef6af-a6ee-41ae-8ca7-d8c52e432fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6ae1835565430eb16ba1ff3758e472'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:34.969586 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1392/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:34.971520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.971837 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.972122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.972587 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1372/2764] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:34 2022] DELETE /identity/v3/users/6b6ae1835565430eb16ba1ff3758e472 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:34.976962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:34.977261 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:34.977674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:34.998270 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:34.999491 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:35.004292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] MFA Rules not processed for user `7bbd6047a4c84ca8a9222aafed38af5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:35.005755 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:35.086628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:35.091786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1373/2765] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:43:35.098856 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1393/2766] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:35.102626 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:35.105571 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:35.110275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:35.113014 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:35.170803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:35.180398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcd084-b00f-467b-b0c7-b4ee2887ca71 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:35.185390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3d123-3491-4590-82f9-44ce1df83ad5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:35.190988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:35.191793 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:35.192456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:35.192812 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:35.193464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:35.194446 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:35.194939 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:35.195561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:35.204535 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:35.206551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:35.209182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:35.210987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:35.218644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1394/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:43:35.225301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1374/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:43:35.592595 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:35.594369 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:35.622408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a65f-6da4-44eb-b18d-bdda6b467731 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:35.634821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:35.635847 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:35.636919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:35.637111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] PATH_INFO: `/v3/projects/d849820d3e164de4ab516ccac6c12d17` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:35.639260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d849820d3e164de4ab516ccac6c12d17)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:35.647046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:35.732692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd849820d3e164de4ab516ccac6c12d17', 'request_id': 'req-83b5e1fe-9510-4f66-8e10-3309b445caf2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.742661 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd849820d3e164de4ab516ccac6c12d17', 'request_id': 'req-83b5e1fe-9510-4f66-8e10-3309b445caf2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.749855 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd849820d3e164de4ab516ccac6c12d17', 'request_id': 'req-83b5e1fe-9510-4f66-8e10-3309b445caf2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.767100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] The token cache is being invalidate because project d849820d3e164de4ab516ccac6c12d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:35.767359 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.767914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83b5e1fe-9510-4f66-8e10-3309b445caf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.770091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1395/2769] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:35 2022] DELETE /identity/v3/projects/d849820d3e164de4ab516ccac6c12d17 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:35.773869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:35.789262 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe206c8-4ff5-4280-a43a-12b54d8918d7 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:35.874580 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:35.875683 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:35.876081 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:35.877005 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] PATH_INFO: `/v3/users/5f3931d7876d406b863f6eb51a021759` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:35.878408 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3931d7876d406b863f6eb51a021759)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:35.880708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:35.960945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3931d7876d406b863f6eb51a021759'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.973541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3931d7876d406b863f6eb51a021759'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.993415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3931d7876d406b863f6eb51a021759'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:35.995118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3931d7876d406b863f6eb51a021759'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.005391 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3931d7876d406b863f6eb51a021759'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.012814 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1375/2770] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:35 2022] DELETE /identity/v3/users/5f3931d7876d406b863f6eb51a021759 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:36.186592 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301eb6-040c-4a6e-bf30-13ca4febe493 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.187031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301eb6-040c-4a6e-bf30-13ca4febe493 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.187147 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301eb6-040c-4a6e-bf30-13ca4febe493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.207139 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-47301eb6-040c-4a6e-bf30-13ca4febe493 None None] MFA Rules not processed for user `05589f6be4c646aca4fbba4e2909f009`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:36.208449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-47301eb6-040c-4a6e-bf30-13ca4febe493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:36.278162 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1396/2771] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:36.339648 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:36.341968 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:36.426142 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d3cf-8acf-4bdf-8a82-e3e761bf8aaf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:36.430966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:36.431872 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.432160 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.432440 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] PATH_INFO: `/v3/projects/53a16686dc8d45e4a15f7665731d6c3e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.433670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a16686dc8d45e4a15f7665731d6c3e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:36.436042 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:36.448508 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:36.496251 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a16686dc8d45e4a15f7665731d6c3e', 'request_id': 'req-9002e97b-7f98-4687-ae51-f07ff97b602d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.505143 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a16686dc8d45e4a15f7665731d6c3e', 'request_id': 'req-9002e97b-7f98-4687-ae51-f07ff97b602d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.512078 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a16686dc8d45e4a15f7665731d6c3e', 'request_id': 'req-9002e97b-7f98-4687-ae51-f07ff97b602d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.526672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] The token cache is being invalidate because project 53a16686dc8d45e4a15f7665731d6c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:36.527051 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.527818 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9002e97b-7f98-4687-ae51-f07ff97b602d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:36.529409 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1376/2772] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:36 2022] DELETE /identity/v3/projects/53a16686dc8d45e4a15f7665731d6c3e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:36.535176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.535944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.536075 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.558890 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:36.560198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:36.583930 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:36.647797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1397/2773] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:36.656057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.656761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.657200 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.686205 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:36.687926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:36.707127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:36.707898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1377/2774] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:36.719146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263b5d-31d7-4d37-a253-14d8498fe90a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:36.725300 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:36.726030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.726408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.726583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.727333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:36.727695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:36.729335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:36.746796 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1398/2775] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:36.748177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:36.759608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48053-2727-44eb-94fe-cf0212b9eda4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:36.765808 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:36.766442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.766750 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.767090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.767904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:36.771539 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:36.828043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1378/2776] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:36 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:36.835554 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:36.849270 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67393637-85fb-432a-be72-94ffd1985c97 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:36.940665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:36.941596 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.941683 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.941959 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.942677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:36.944735 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:36.967418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1399/2777] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:36 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:36.971630 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:36.982104 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927021-b668-4e1e-8886-322cb9ba18cd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:36.989156 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:36.990976 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:36.991471 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:36.993111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:36.994211 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:36.997410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.014930 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1379/2778] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:37.018931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.030556 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c415e1b-072d-476d-868c-852e267bd6ec admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.035435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e85819-00f4-4ff5-85d8-821ae1ab8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.036204 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e85819-00f4-4ff5-85d8-821ae1ab8ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.036490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e85819-00f4-4ff5-85d8-821ae1ab8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.036770 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e85819-00f4-4ff5-85d8-821ae1ab8ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.037505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e85819-00f4-4ff5-85d8-821ae1ab8ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.039115 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e85819-00f4-4ff5-85d8-821ae1ab8ee2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.052362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1400/2779] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:37.056558 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.067706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90981e-9149-4f2c-b6c9-23e3b9c5a1bd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.073557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.074072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.074360 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.074637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] PATH_INFO: `/v3/projects/3a6a93ec444b444eb846babf5e7d3fe3/users/a3a7ed189e1e4dc7b81d4da682d085dd/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.093724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6a93ec444b444eb846babf5e7d3fe3, user_id=a3a7ed189e1e4dc7b81d4da682d085dd, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.096690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.112161 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1380/2780] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:37 2022] PUT /identity/v3/projects/3a6a93ec444b444eb846babf5e7d3fe3/users/a3a7ed189e1e4dc7b81d4da682d085dd/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:37.122572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.122860 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.123349 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.154776 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] MFA Rules not processed for user `a3a7ed189e1e4dc7b81d4da682d085dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:37.156041 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:37.251877 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1401/2781] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:37.254495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.358623 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c148-6eb7-4dd4-86db-b027fbfcc1aa admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.365438 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.366127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.366412 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.366686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.367385 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.369390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.409569 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1381/2782] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:37 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:37.410725 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.423031 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6fd9-eb20-4089-8e81-ad9a5b825ebe None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.441936 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:37.505761 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.506822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.508034 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.509205 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.510175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.513279 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.550348 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1402/2783] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:37 2022] POST /identity/v3/users => generated 303 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:43:37.554479 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.569088 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1455a4-e208-4c99-ad6f-175fe71b66f5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.574309 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.575134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.575433 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.575731 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.576506 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.578314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.596700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1382/2784] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:37.600814 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.612316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49d09-8422-4151-a650-67d99e65b8f5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.620646 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.625165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.625165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.625165 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] PATH_INFO: `/v3/projects/6b129d781756440cb16ac3dc48965d20/users/4fa9aa6641434c0991e82b5611048e54/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.644286 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b129d781756440cb16ac3dc48965d20, user_id=4fa9aa6641434c0991e82b5611048e54, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.647058 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.667123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1403/2785] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:37 2022] PUT /identity/v3/projects/6b129d781756440cb16ac3dc48965d20/users/4fa9aa6641434c0991e82b5611048e54/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:37.668216 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.679119 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffe767-4357-45be-a3ca-59129eedee3b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.688291 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:37.758043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a43ebc-9487-490a-a945-0c358d8e506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.758992 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a43ebc-9487-490a-a945-0c358d8e506d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.759277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a43ebc-9487-490a-a945-0c358d8e506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.759565 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a43ebc-9487-490a-a945-0c358d8e506d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.760380 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a43ebc-9487-490a-a945-0c358d8e506d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.761982 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a43ebc-9487-490a-a945-0c358d8e506d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.773886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1383/2786] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:37.777881 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.790181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce01ba0-9ebc-47f6-9089-68207c6c3bff admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:37.796775 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:37.797829 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.798137 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.798425 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] PATH_INFO: `/v3/projects/6b129d781756440cb16ac3dc48965d20/users/4fa9aa6641434c0991e82b5611048e54/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.807835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b129d781756440cb16ac3dc48965d20, user_id=4fa9aa6641434c0991e82b5611048e54, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:37.807835 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:37.818924 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1404/2787] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:37 2022] PUT /identity/v3/projects/6b129d781756440cb16ac3dc48965d20/users/4fa9aa6641434c0991e82b5611048e54/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:37.833690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:37.833690 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:37.834212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:37.871866 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] MFA Rules not processed for user `4fa9aa6641434c0991e82b5611048e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:37.873300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:37.966097 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1384/2788] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:37.978459 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:37.981375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:38.081103 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a81499-0552-4404-81f9-9955ace3f4e7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:38.086486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:38.087215 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:38.087560 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:38.087895 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:38.108297 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:38.110537 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:38.121636 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1405/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:38.223400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:38.241370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84f8f9-932e-45c9-a5a5-8276b9b61701 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:38.248634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279fda-cf30-4003-a528-11b2b7e1e2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:38.249621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279fda-cf30-4003-a528-11b2b7e1e2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:38.250127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279fda-cf30-4003-a528-11b2b7e1e2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:38.250240 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279fda-cf30-4003-a528-11b2b7e1e2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:38.358560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279fda-cf30-4003-a528-11b2b7e1e2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:38.363940 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279fda-cf30-4003-a528-11b2b7e1e2aa service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:38.375915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1385/2790] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:41.028318 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:41.030274 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:41.097884 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3845790-00dd-42c0-848b-b65e6c254c1d service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:41.102565 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:41.103444 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:41.103739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:41.104037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] PATH_INFO: `/v3/users/7bbd6047a4c84ca8a9222aafed38af5c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:41.105277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbd6047a4c84ca8a9222aafed38af5c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:41.107352 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:41.133081 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:41.164365 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbd6047a4c84ca8a9222aafed38af5c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.171666 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbd6047a4c84ca8a9222aafed38af5c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.184213 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbd6047a4c84ca8a9222aafed38af5c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.184938 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbd6047a4c84ca8a9222aafed38af5c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.192433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbd6047a4c84ca8a9222aafed38af5c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.199304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1406/2791] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:41 2022] DELETE /identity/v3/users/7bbd6047a4c84ca8a9222aafed38af5c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:41.204995 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:41.205482 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:41.205595 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:41.223296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:41.224527 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:41.253069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:41.290917 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1386/2792] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:41.301295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:41.302733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:41.376742 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e247fe-589c-42c6-8a9a-8290f4b2030a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:41.381719 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:41.382375 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:41.382778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:41.382931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:41.398216 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:41.400549 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:41.415652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1407/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:41.878163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:41.884843 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:41.898775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1d055-63b7-4fb1-89a9-6913c8aa1bd0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:41.904180 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:41.905273 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:41.905560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:41.905839 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] PATH_INFO: `/v3/users/a3a7ed189e1e4dc7b81d4da682d085dd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:41.907140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a7ed189e1e4dc7b81d4da682d085dd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:41.909122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:41.960419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a7ed189e1e4dc7b81d4da682d085dd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.968067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a7ed189e1e4dc7b81d4da682d085dd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.988136 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a7ed189e1e4dc7b81d4da682d085dd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.988922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a7ed189e1e4dc7b81d4da682d085dd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:41.998262 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:42.000435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:42.006163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0a2fd94f-8598-4dae-8597-baacc1ee0611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a7ed189e1e4dc7b81d4da682d085dd'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.015802 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1387/2794] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:41 2022] DELETE /identity/v3/users/a3a7ed189e1e4dc7b81d4da682d085dd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:42.019576 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:42.020111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:42.020694 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80f63f-acc6-46bf-916a-5adbc37ca6e9 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:42.020945 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:42.043891 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:42.045127 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:42.084733 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:42.085604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:42.085885 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:42.086258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] PATH_INFO: `/v3/projects/98bdaa297d2540f0a8ec94628b46024a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:42.087378 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bdaa297d2540f0a8ec94628b46024a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:42.089322 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:42.111367 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1388/2795] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:42.122244 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:42.123399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:42.135280 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:42.150662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bdaa297d2540f0a8ec94628b46024a', 'request_id': 'req-b274a870-ecda-46c7-83af-f232d22702f3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.161235 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bdaa297d2540f0a8ec94628b46024a', 'request_id': 'req-b274a870-ecda-46c7-83af-f232d22702f3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.169214 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bdaa297d2540f0a8ec94628b46024a', 'request_id': 'req-b274a870-ecda-46c7-83af-f232d22702f3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.181197 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] The token cache is being invalidate because project 98bdaa297d2540f0a8ec94628b46024a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:42.181482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.182149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.184080 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1408/2796] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:41 2022] DELETE /identity/v3/projects/98bdaa297d2540f0a8ec94628b46024a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:42.196069 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:42.210265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3d0a-17a9-44bc-9147-b969dc25c233 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:42.271420 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:42.272289 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:42.272755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:42.273040 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:42.275105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:42.351307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:42.352915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:42.364182 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1389/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:42.648123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:42.649784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:42.663627 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a870-ecda-46c7-83af-f232d22702f3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:42.668769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:42.669720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:42.670123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:42.670594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] PATH_INFO: `/v3/projects/3a6a93ec444b444eb846babf5e7d3fe3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:42.671744 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6a93ec444b444eb846babf5e7d3fe3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:42.674561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:42.727071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6a93ec444b444eb846babf5e7d3fe3', 'request_id': 'req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.734946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6a93ec444b444eb846babf5e7d3fe3', 'request_id': 'req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.741988 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6a93ec444b444eb846babf5e7d3fe3', 'request_id': 'req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.755495 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] The token cache is being invalidate because project 3a6a93ec444b444eb846babf5e7d3fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:42.755821 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.756505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.758194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1409/2798] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:42 2022] DELETE /identity/v3/projects/3a6a93ec444b444eb846babf5e7d3fe3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:42.762302 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:42.773706 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a30bd-59ea-4db6-a8a7-ec580deda7a9 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:42.831670 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:42.832708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:42.832999 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:42.833296 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] PATH_INFO: `/v3/users/4fa9aa6641434c0991e82b5611048e54` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:42.834507 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa9aa6641434c0991e82b5611048e54)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:42.836505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:42.887535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa9aa6641434c0991e82b5611048e54'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.891645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:42.897079 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa9aa6641434c0991e82b5611048e54'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.912341 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa9aa6641434c0991e82b5611048e54'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.913073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa9aa6641434c0991e82b5611048e54'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.920179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c9f751ad-f5ab-4388-9c72-aa68623b19f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa9aa6641434c0991e82b5611048e54'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:42.926716 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1390/2799] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:42 2022] DELETE /identity/v3/users/4fa9aa6641434c0991e82b5611048e54 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:43.210396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.214023 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:43.228100 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137bbf1-4b23-41d9-8a26-04ba1b6f2880 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.299852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.300635 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.300978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.301194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] PATH_INFO: `/v3/projects/6b129d781756440cb16ac3dc48965d20` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.302408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b129d781756440cb16ac3dc48965d20)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.304364 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.357931 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b129d781756440cb16ac3dc48965d20', 'request_id': 'req-1170fb85-586f-4611-b81a-e4b10243f214'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:43.360522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:43.365609 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b129d781756440cb16ac3dc48965d20', 'request_id': 'req-1170fb85-586f-4611-b81a-e4b10243f214'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:43.373002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b129d781756440cb16ac3dc48965d20', 'request_id': 'req-1170fb85-586f-4611-b81a-e4b10243f214'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:43.385522 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] The token cache is being invalidate because project 6b129d781756440cb16ac3dc48965d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:43.385810 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:43.386474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1170fb85-586f-4611-b81a-e4b10243f214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:43.388180 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1410/2800] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:43 2022] DELETE /identity/v3/projects/6b129d781756440cb16ac3dc48965d20 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:43.393816 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.394329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.394432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.412692 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:43.413882 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:43.476439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1391/2801] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:43.484292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.484585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.484849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.504813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:43.506036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:43.514505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1411/2802] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:43.518751 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.528826 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbb4c8-97da-4579-a780-a2b82b5c23d1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.533612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.534277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.534561 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.534837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.535566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:43.535908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.537511 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.549567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1392/2803] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:43.554019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.565024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd5ae6-c402-47b2-92e0-0bd6d5c0c91b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.569875 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.570544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.570822 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.571092 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.571799 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.573739 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.598803 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1412/2804] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:43 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:43.603501 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.615399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece5d2-a364-4bf7-9a52-ea414b34edb0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.673975 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.674705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.674994 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.675277 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.676066 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.678044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.699253 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1393/2805] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:43 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:43.703626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.714491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaa7cd-7848-4750-a9c9-aaadc0779ab8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.719329 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.720046 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.720328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.720604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.721337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.722970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.733998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1413/2806] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:43.738645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.749164 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91375-0c54-4bef-a69f-d9adce3af4d8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.755393 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f2637-27eb-4201-b25c-c8c900878bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.756108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2637-27eb-4201-b25c-c8c900878bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.756390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2637-27eb-4201-b25c-c8c900878bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.756666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2637-27eb-4201-b25c-c8c900878bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.757401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f2637-27eb-4201-b25c-c8c900878bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.759035 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f2637-27eb-4201-b25c-c8c900878bc7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.769674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1394/2807] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:43.773818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:43.783870 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0820b-fea3-47e9-aac2-50589ca29094 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:43.788571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:43.789454 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.789731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.790003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] PATH_INFO: `/v3/projects/6af6743682e44f49aca6f5616aebbfba/users/a665e11575634369a3445d07247f5216/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.805989 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af6743682e44f49aca6f5616aebbfba, user_id=a665e11575634369a3445d07247f5216, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:43.808655 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:43.822658 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1414/2808] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:43 2022] PUT /identity/v3/projects/6af6743682e44f49aca6f5616aebbfba/users/a665e11575634369a3445d07247f5216/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:43.889375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:43.889672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:43.889959 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:43.919755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] MFA Rules not processed for user `a665e11575634369a3445d07247f5216`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:43.921121 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:43.947167 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:43.998111 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1395/2809] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:43.999469 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.075981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdbc6c-8914-4817-8de7-834bd0b97f7a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.083144 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.083910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.084217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.084525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.085265 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.087296 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.115064 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1415/2810] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:43 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:44.119085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.130407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43473f86-83c5-4ded-abc9-6c779a6f8f64 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.189149 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.189830 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.190118 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.190399 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.191105 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.193044 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.214183 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1396/2811] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:44 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:44.218335 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.229502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093d117-f562-4518-b458-2f15f8c29264 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.234372 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.235037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.235358 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.235806 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.236574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.238465 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.250516 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1416/2812] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:44.255010 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.266052 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65767-4a59-4461-a0d2-a49d27835ce5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.271594 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.272573 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.272857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.273135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] PATH_INFO: `/v3/projects/e78fc6fc9fea47fa89318a5e735159ab/users/41ac73b44dc744a3bcd73d67e077b410/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.293892 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78fc6fc9fea47fa89318a5e735159ab, user_id=41ac73b44dc744a3bcd73d67e077b410, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.296966 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.310803 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1397/2813] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:44 2022] PUT /identity/v3/projects/e78fc6fc9fea47fa89318a5e735159ab/users/41ac73b44dc744a3bcd73d67e077b410/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:44.314996 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.325585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236da1a-722e-4178-8dee-adfb7263a265 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.375148 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:44.387843 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9a6de-36a3-4e4d-855c-1a192439e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.388783 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9a6de-36a3-4e4d-855c-1a192439e05f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.389093 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9a6de-36a3-4e4d-855c-1a192439e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.389361 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9a6de-36a3-4e4d-855c-1a192439e05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.390111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9a6de-36a3-4e4d-855c-1a192439e05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.392281 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9a6de-36a3-4e4d-855c-1a192439e05f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.402900 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1417/2814] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:44.407129 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.418389 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec4a2-1182-4cf8-8cb2-cb38bcb4d61c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.423204 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.424122 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.424407 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.424687 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] PATH_INFO: `/v3/projects/e78fc6fc9fea47fa89318a5e735159ab/users/41ac73b44dc744a3bcd73d67e077b410/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.426694 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78fc6fc9fea47fa89318a5e735159ab, user_id=41ac73b44dc744a3bcd73d67e077b410, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.429366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.439998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1398/2815] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:44 2022] PUT /identity/v3/projects/e78fc6fc9fea47fa89318a5e735159ab/users/41ac73b44dc744a3bcd73d67e077b410/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:44.452105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.452396 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.452677 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.480582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] MFA Rules not processed for user `41ac73b44dc744a3bcd73d67e077b410`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:44.481975 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:44.552461 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1418/2816] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:44.563210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.565049 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:44.629214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d7b2-7f4f-461e-a475-e2b826114d17 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.632873 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.633528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.633815 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.634094 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.646503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.646503 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.657400 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1399/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:44.757669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:44.768529 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8064878-1e8f-449f-8825-88f01225de18 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:44.772410 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955fb3b-ff1f-4d21-895b-07aa68e89c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:44.773074 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955fb3b-ff1f-4d21-895b-07aa68e89c69 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:44.773557 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955fb3b-ff1f-4d21-895b-07aa68e89c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:44.773836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955fb3b-ff1f-4d21-895b-07aa68e89c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:44.833059 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955fb3b-ff1f-4d21-895b-07aa68e89c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:44.834511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955fb3b-ff1f-4d21-895b-07aa68e89c69 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:44.843623 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1419/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:47.432188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:47.458353 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:47.505666 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d1633-5dac-425b-8968-44c0bd3ee079 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:47.510370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:47.511645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:47.511645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:47.511881 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] PATH_INFO: `/v3/users/a665e11575634369a3445d07247f5216` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:47.513046 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a665e11575634369a3445d07247f5216)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:47.515227 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:47.562020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a665e11575634369a3445d07247f5216'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:47.569622 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a665e11575634369a3445d07247f5216'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:47.582308 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a665e11575634369a3445d07247f5216'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:47.582977 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a665e11575634369a3445d07247f5216'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:47.590011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a665e11575634369a3445d07247f5216'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:47.596516 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1400/2819] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:47 2022] DELETE /identity/v3/users/a665e11575634369a3445d07247f5216 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:47.601181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:47.601682 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:47.601801 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:47.619964 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:47.621314 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:47.681337 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1420/2820] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:47.691674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:47.693114 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:47.752012 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbf09-2a48-48ca-a7af-915c5a135a33 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:47.762271 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:47.762513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:47.762625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:47.762880 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:47.774441 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:47.775913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:47.786045 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1401/2821] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:48.075784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:48.077366 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:48.090530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b3238-e5d9-4078-918c-0d104ffac3a6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:48.096611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:48.097728 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.097911 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.098091 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] PATH_INFO: `/v3/projects/6af6743682e44f49aca6f5616aebbfba` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.099463 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af6743682e44f49aca6f5616aebbfba)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:48.102277 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:48.109374 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:48.155110 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af6743682e44f49aca6f5616aebbfba', 'request_id': 'req-20015a33-0f74-4dc4-8fec-81263f2c0759'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.162684 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af6743682e44f49aca6f5616aebbfba', 'request_id': 'req-20015a33-0f74-4dc4-8fec-81263f2c0759'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.168394 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af6743682e44f49aca6f5616aebbfba', 'request_id': 'req-20015a33-0f74-4dc4-8fec-81263f2c0759'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.180168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] The token cache is being invalidate because project 6af6743682e44f49aca6f5616aebbfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:48.180481 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.181123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.182657 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1421/2822] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:48 2022] DELETE /identity/v3/projects/6af6743682e44f49aca6f5616aebbfba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:48.186922 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:48.197536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7be0-0372-4d05-83cc-a01d636964dc service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:48.240071 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:48.258936 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:48.259861 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.260144 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.260423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] PATH_INFO: `/v3/users/41ac73b44dc744a3bcd73d67e077b410` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.261657 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ac73b44dc744a3bcd73d67e077b410)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:48.263862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:48.315276 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ac73b44dc744a3bcd73d67e077b410'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.322439 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ac73b44dc744a3bcd73d67e077b410'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.334804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ac73b44dc744a3bcd73d67e077b410'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.335487 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ac73b44dc744a3bcd73d67e077b410'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.343030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-600d8e22-3842-4cc4-8eba-4142d859a4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ac73b44dc744a3bcd73d67e077b410'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.349799 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1402/2823] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:43:48 2022] DELETE /identity/v3/users/41ac73b44dc744a3bcd73d67e077b410 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:48.636146 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:48.637768 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:48.652035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20015a33-0f74-4dc4-8fec-81263f2c0759 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:48.710802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:48.711833 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.712120 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.712476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] PATH_INFO: `/v3/projects/e78fc6fc9fea47fa89318a5e735159ab` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.713606 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78fc6fc9fea47fa89318a5e735159ab)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:48.715509 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:48.763236 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78fc6fc9fea47fa89318a5e735159ab', 'request_id': 'req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.770832 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78fc6fc9fea47fa89318a5e735159ab', 'request_id': 'req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.776594 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78fc6fc9fea47fa89318a5e735159ab', 'request_id': 'req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.787534 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] The token cache is being invalidate because project e78fc6fc9fea47fa89318a5e735159ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:43:48.787849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.788526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fcb8350b-76c6-4aa2-bd2f-00e17bb3ab58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:43:48.790065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1422/2824] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:43:48 2022] DELETE /identity/v3/projects/e78fc6fc9fea47fa89318a5e735159ab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:43:48.795108 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.795624 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.795875 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.818486 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:48.819698 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:48.879075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1403/2825] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:48.888390 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.888942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.889224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.908272 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:48.909588 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:48.917583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1423/2826] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:48.921910 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:48.932293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3616b-9597-423e-a3a1-7dd79ea3e643 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:48.936965 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:48.937631 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.937918 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.938199 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.939504 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:43:48.939846 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:48.941442 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:48.953313 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1404/2827] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:43:48.957562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:48.967158 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb128e8-498c-4f33-91da-ea6848be2bb3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:48.971826 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:48.972482 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:48.972764 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:48.973037 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:48.973729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:48.975613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:48.990088 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:49.004340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1424/2828] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:43:48 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:49.008998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:49.020068 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536028ae-be53-4db3-bedf-98dc5f357563 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:49.071794 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:49.085739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:49.086421 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:49.086708 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:49.086987 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:49.087684 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:49.089615 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:49.109335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1405/2829] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:43:49 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:43:49.114192 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:49.124868 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae63fdd-481b-48a4-8e04-430a65436ea5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:49.130221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:49.130880 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:49.131157 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:49.131434 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:49.132266 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:49.133859 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:49.144631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1425/2830] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:49.148895 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:49.159809 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df69e1-a571-48bf-9172-4aad2811a503 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:49.164564 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d9dd-29af-4c39-9e40-d8b94798b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:49.165366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d9dd-29af-4c39-9e40-d8b94798b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:49.165658 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d9dd-29af-4c39-9e40-d8b94798b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:49.165938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d9dd-29af-4c39-9e40-d8b94798b6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:49.166675 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d9dd-29af-4c39-9e40-d8b94798b6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:49.168303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d9dd-29af-4c39-9e40-d8b94798b6bd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:49.179991 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1406/2831] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:43:49.184308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:49.194362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde152d-f68a-4eed-b9cf-c274b17956a7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:49.198912 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:49.199824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:49.200105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:49.200381 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] PATH_INFO: `/v3/projects/469f5571363b4f84a013dbb0edf7cbe1/users/1728cefc42b94b1fa416d1b22360a29a/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:49.214974 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469f5571363b4f84a013dbb0edf7cbe1, user_id=1728cefc42b94b1fa416d1b22360a29a, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:49.217701 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:49.231473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1426/2832] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:43:49 2022] PUT /identity/v3/projects/469f5571363b4f84a013dbb0edf7cbe1/users/1728cefc42b94b1fa416d1b22360a29a/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:43:49.243295 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:49.243584 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:49.243897 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:49.271746 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] MFA Rules not processed for user `1728cefc42b94b1fa416d1b22360a29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:43:49.272938 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:49.335726 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1407/2833] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:43:49.348491 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:49.350278 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:49.407590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e573dd-d78d-476d-b3a4-010ebb4f6895 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:49.411678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:49.412474 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:49.412817 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:49.413098 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:49.422240 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:49.424420 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:49.433517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1427/2834] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:50.945935 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:43:50.947582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:51.007709 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736931-a125-493c-86ca-c03eb5a0179e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:43:51.011510 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:43:51.012188 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:43:51.012470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:43:51.012742 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:43:51.014822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:43:51.024909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:43:51.026314 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7dde-1a3f-4cd5-8fd4-5e96229f2432 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:43:51.035870 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1408/2835] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:43:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:43:59.429323 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:00.852550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:00.916145 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741aef6-e802-40a3-8a52-23c55baf6d24 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:00.921397 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:00.922340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:00.922622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:00.922906 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] PATH_INFO: `/v3/users/1728cefc42b94b1fa416d1b22360a29a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:00.924187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1728cefc42b94b1fa416d1b22360a29a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:00.926124 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:00.975473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1728cefc42b94b1fa416d1b22360a29a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:00.985542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1728cefc42b94b1fa416d1b22360a29a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:00.998333 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1728cefc42b94b1fa416d1b22360a29a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:00.999089 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1728cefc42b94b1fa416d1b22360a29a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.008787 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1728cefc42b94b1fa416d1b22360a29a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.016490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1428/2836] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:44:00 2022] DELETE /identity/v3/users/1728cefc42b94b1fa416d1b22360a29a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:01.021228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.021761 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.022366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.044865 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:01.046346 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:01.110837 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:01.122175 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1409/2837] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:01.133053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:01.134590 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:01.198618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d352-ada4-4352-a6b1-513e61d6dfaa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:01.202295 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617659d-9cd1-4ea9-90df-a61051628fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:01.202942 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617659d-9cd1-4ea9-90df-a61051628fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.203221 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617659d-9cd1-4ea9-90df-a61051628fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.204085 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617659d-9cd1-4ea9-90df-a61051628fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.213241 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617659d-9cd1-4ea9-90df-a61051628fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:01.214662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617659d-9cd1-4ea9-90df-a61051628fd0 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:01.224033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1429/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:44:01.499745 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:01.502193 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:01.588057 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d39ef7-141b-4546-83f7-e79c4a929878 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:01.592876 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:01.593736 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.594023 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.594305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] PATH_INFO: `/v3/projects/469f5571363b4f84a013dbb0edf7cbe1` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.595513 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] RBAC: Authorizing `identity:delete_project(project_id=469f5571363b4f84a013dbb0edf7cbe1)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:01.597455 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:01.644242 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469f5571363b4f84a013dbb0edf7cbe1', 'request_id': 'req-4cb1d0aa-e01d-4201-a1c7-457c628d4add'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.651481 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469f5571363b4f84a013dbb0edf7cbe1', 'request_id': 'req-4cb1d0aa-e01d-4201-a1c7-457c628d4add'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.657493 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469f5571363b4f84a013dbb0edf7cbe1', 'request_id': 'req-4cb1d0aa-e01d-4201-a1c7-457c628d4add'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.670067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] The token cache is being invalidate because project 469f5571363b4f84a013dbb0edf7cbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:44:01.670357 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.670998 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4cb1d0aa-e01d-4201-a1c7-457c628d4add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:01.673073 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1410/2839] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:44:01 2022] DELETE /identity/v3/projects/469f5571363b4f84a013dbb0edf7cbe1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:01.677954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.678239 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.678517 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.705263 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:01.735581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:01.736802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:01.800122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1430/2840] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:01.808459 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.808969 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.809235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.831678 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:01.832829 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:01.841154 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1411/2841] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:44:01.845866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:01.855644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6726c55-7e6a-4f5a-aca9-48a3713c59b8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:01.861061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:01.861726 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.862011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.862290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.863026 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:44:01.863338 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:01.864981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:01.877196 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1431/2842] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:44:01.881862 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:01.891680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d686-1421-44e0-ad26-e9b63f78784a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:01.896436 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:01.897085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:01.897371 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:01.897645 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:01.898369 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:01.900290 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:01.930519 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1412/2843] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:44:01 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:44:01.931615 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:01.941818 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edd7f-6901-45f4-97b6-c9d379a5312b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:01.999662 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.000449 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.000720 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.001002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.001709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.003645 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.024428 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1432/2844] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:44:01 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 09:44:02.028656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.040086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb127-64ec-423d-b176-2dc1ee798350 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.044767 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.045429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.045714 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.045996 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.046724 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.049018 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.059526 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1413/2845] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:02.063498 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.073566 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e711d-3d8e-4d5d-942a-9a3295b3373d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.078489 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e88f7-9554-4846-bc81-475894e55651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.079153 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e88f7-9554-4846-bc81-475894e55651 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.079439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e88f7-9554-4846-bc81-475894e55651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.079763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e88f7-9554-4846-bc81-475894e55651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.080497 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e88f7-9554-4846-bc81-475894e55651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.082097 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e88f7-9554-4846-bc81-475894e55651 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.092290 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1433/2846] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:02.096715 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.106757 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247fda-fbd2-4c9a-8801-c144b8a704ed admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.112387 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.113298 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.113582 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.113855 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] PATH_INFO: `/v3/projects/71141d39768d480b876dc5c907821a2b/users/2fa13b3bda404123a22f221710245b66/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.128532 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=71141d39768d480b876dc5c907821a2b, user_id=2fa13b3bda404123a22f221710245b66, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.131190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.144723 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1414/2847] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:44:02 2022] PUT /identity/v3/projects/71141d39768d480b876dc5c907821a2b/users/2fa13b3bda404123a22f221710245b66/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:44:02.157273 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.157558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.157836 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.189002 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] MFA Rules not processed for user `2fa13b3bda404123a22f221710245b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:02.190219 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:02.237692 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:02.258709 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1434/2848] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:44:02.263661 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.284754 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:02.333272 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1817e-6d00-4c67-8fbd-c564164c56ac admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.338286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.338955 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.339235 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.339505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.340246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.342401 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.370610 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1415/2849] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:44:02 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:44:02.375077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.386737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897b853-b4a9-46f0-b3a6-2029f81f2b96 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.444695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.445486 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.445774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.446052 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.446752 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.448712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.469966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1435/2850] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:44:02 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:44:02.475557 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.491755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ea78-f6f6-4cbb-9906-c5078690da79 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.497560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.498608 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.498909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.499171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.499948 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.502130 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.516300 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1416/2851] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:02.520311 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.523680 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.525556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:02.530981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f6112-2f09-45b0-88e8-791c61b96812 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.535702 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.536400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.536685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.536965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.537737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.539351 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.553953 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1436/2852] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:02.555541 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.572685 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f8459-ed78-42b1-a002-960a19f5a201 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.581577 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d022b54-9e92-44d3-a7ba-a515cca4eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.582954 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022b54-9e92-44d3-a7ba-a515cca4eeef admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.583402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022b54-9e92-44d3-a7ba-a515cca4eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.583919 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022b54-9e92-44d3-a7ba-a515cca4eeef admin admin] PATH_INFO: `/v3/projects/7403b38bcf364a7386168d090a90a6dc/users/403f3375e6be47ae8e2cd2930cf39425/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.607970 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022b54-9e92-44d3-a7ba-a515cca4eeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7403b38bcf364a7386168d090a90a6dc, user_id=403f3375e6be47ae8e2cd2930cf39425, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.613316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022b54-9e92-44d3-a7ba-a515cca4eeef admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.629271 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1437/2853] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:44:02 2022] PUT /identity/v3/projects/7403b38bcf364a7386168d090a90a6dc/users/403f3375e6be47ae8e2cd2930cf39425/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:02.639550 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.639872 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.640009 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522f569-038e-4c74-970d-dcba2d6bcd87 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.640152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.666901 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] MFA Rules not processed for user `403f3375e6be47ae8e2cd2930cf39425`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:02.668138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:02.692840 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.693634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.693924 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.694207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.696072 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:02.737621 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1438/2854] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:44:02.738729 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.746634 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:02.766663 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.768181 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.772849 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:02.779086 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1417/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:02.805418 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178302ba-3bdf-4167-880f-45953f3fb0fa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.811003 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.811689 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.812006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.812283 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.813210 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.816051 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.870016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1439/2856] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:44:02 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:44:02.872765 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.889900 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560b874-abf2-445d-8eaa-100b4da21980 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.954067 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.954886 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:02.955171 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:02.955448 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:02.956179 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:02.958116 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:02.979286 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1418/2857] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:44:02 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:44:02.983328 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:02.994499 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cfd24-85f0-4726-974e-7a837f370674 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:02.999223 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:02.999940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:03.000355 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:03.000673 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:03.001629 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:03.003408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:03.019036 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1440/2858] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 09:44:03.020329 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:03.030920 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d428e-aedf-48ab-984e-07cea954731d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:03.036660 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:03.037556 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:03.037833 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:03.038103 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] PATH_INFO: `/v3/projects/6b9433703ac747aea02936a23902a7af/users/71b35251f2804882aac9a9d7d9928783/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:03.054431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9433703ac747aea02936a23902a7af, user_id=71b35251f2804882aac9a9d7d9928783, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:03.057629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:03.072184 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1419/2859] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:44:03 2022] PUT /identity/v3/projects/6b9433703ac747aea02936a23902a7af/users/71b35251f2804882aac9a9d7d9928783/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:44:03.076027 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:03.086913 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caaf09-bbe7-4875-a5cc-44603929ad15 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:03.145981 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba083f09-b850-4067-a6bc-571ba1795ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:03.146669 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083f09-b850-4067-a6bc-571ba1795ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:03.146966 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083f09-b850-4067-a6bc-571ba1795ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:03.147243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba083f09-b850-4067-a6bc-571ba1795ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:03.148017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba083f09-b850-4067-a6bc-571ba1795ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:03.149853 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba083f09-b850-4067-a6bc-571ba1795ab7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:03.165782 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1441/2860] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:03.167191 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:03.181237 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c007-6df6-437e-8f3e-ddea7ef1879f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:03.188913 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:03.190410 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:03.190919 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:03.191398 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] PATH_INFO: `/v3/projects/6b9433703ac747aea02936a23902a7af/users/71b35251f2804882aac9a9d7d9928783/roles/2e997984fe364ad8afd717716e701a23` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:03.194450 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9433703ac747aea02936a23902a7af, user_id=71b35251f2804882aac9a9d7d9928783, role_id=2e997984fe364ad8afd717716e701a23)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:03.197228 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:03.210307 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1420/2861] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:44:03 2022] PUT /identity/v3/projects/6b9433703ac747aea02936a23902a7af/users/71b35251f2804882aac9a9d7d9928783/roles/2e997984fe364ad8afd717716e701a23 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:03.226198 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:03.226487 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:03.226816 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:03.267030 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] MFA Rules not processed for user `71b35251f2804882aac9a9d7d9928783`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:03.268874 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:03.346346 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1442/2862] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:03.357636 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:03.359345 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:03.424443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5c1f-ba81-4c41-8478-37f1de815ad3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:03.428058 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:03.428749 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:03.429030 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:03.429303 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:03.479599 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:03.492885 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:03.494422 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:03.504203 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1421/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:05.017670 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:05.019128 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:05.032087 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d410cd-bba1-497c-9de0-704793664d2c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:05.035798 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:05.036456 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:05.036737 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:05.037011 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:05.067756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:05.104644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:05.106174 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:05.116708 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1443/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:05.673056 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:05.681748 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872a99-3ba6-4788-856f-ced2b8076b79 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:05.685419 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d953d-e901-4c6f-9ffe-1fa4b5b78198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:05.686047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d953d-e901-4c6f-9ffe-1fa4b5b78198 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:05.686334 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d953d-e901-4c6f-9ffe-1fa4b5b78198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:05.686616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d953d-e901-4c6f-9ffe-1fa4b5b78198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:05.696294 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d953d-e901-4c6f-9ffe-1fa4b5b78198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:05.697729 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d953d-e901-4c6f-9ffe-1fa4b5b78198 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:05.707923 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1422/2865] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:09.729675 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:09.791842 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454122d4-8317-4daf-833b-0184eeae870f service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:09.796400 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:09.797292 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:09.797575 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:09.797851 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] PATH_INFO: `/v3/users/2fa13b3bda404123a22f221710245b66` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:09.799035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa13b3bda404123a22f221710245b66)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:09.801000 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:09.848166 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa13b3bda404123a22f221710245b66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:09.855593 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa13b3bda404123a22f221710245b66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:09.867386 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa13b3bda404123a22f221710245b66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:09.868071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa13b3bda404123a22f221710245b66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:09.875512 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa13b3bda404123a22f221710245b66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:09.882121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1444/2866] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:44:09 2022] DELETE /identity/v3/users/2fa13b3bda404123a22f221710245b66 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:09.886831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:09.887375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:09.887375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:09.905859 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:09.907874 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:09.966490 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1423/2867] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:09.976980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:09.978447 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:10.025955 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:10.039061 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5a66f-8f55-42b7-9370-b9b63eacba4d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:10.042914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:10.043510 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:10.043850 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:10.044111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:10.056172 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:10.057820 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:10.067797 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1445/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:10.160523 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:10.162125 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:10.267256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e3261-a6d0-44bb-b44c-8cf48b39711e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:10.272739 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:10.273267 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:10.273560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:10.273841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:10.275672 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:10.288135 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:10.289836 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:10.301616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1424/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:10.362340 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:10.364017 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:10.386231 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73ef1-4113-4a51-8c46-9bcc196ecdb6 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:10.395079 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:10.396105 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:10.396480 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:10.396769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] PATH_INFO: `/v3/projects/71141d39768d480b876dc5c907821a2b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:10.398013 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71141d39768d480b876dc5c907821a2b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:10.400227 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:10.454190 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71141d39768d480b876dc5c907821a2b', 'request_id': 'req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.462276 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71141d39768d480b876dc5c907821a2b', 'request_id': 'req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.468613 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71141d39768d480b876dc5c907821a2b', 'request_id': 'req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.480695 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] The token cache is being invalidate because project 71141d39768d480b876dc5c907821a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:44:10.480983 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.481644 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.483182 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1446/2870] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:44:10 2022] DELETE /identity/v3/projects/71141d39768d480b876dc5c907821a2b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:10.487786 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:10.498362 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b898bd-4973-45e1-8175-cfcd42213206 service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:10.542325 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:10.555635 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:10.556497 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:10.556775 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:10.557043 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] PATH_INFO: `/v3/users/403f3375e6be47ae8e2cd2930cf39425` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:10.558231 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=403f3375e6be47ae8e2cd2930cf39425)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:10.560165 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:10.607741 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403f3375e6be47ae8e2cd2930cf39425'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.615301 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403f3375e6be47ae8e2cd2930cf39425'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.627912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403f3375e6be47ae8e2cd2930cf39425'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.628560 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403f3375e6be47ae8e2cd2930cf39425'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.636612 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403f3375e6be47ae8e2cd2930cf39425'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:10.642926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1425/2871] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:44:10 2022] DELETE /identity/v3/users/403f3375e6be47ae8e2cd2930cf39425 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:10.928769 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:10.930243 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:10.945882 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e53c-6667-43a8-b2cf-2a4c4e1b5b61 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:11.004122 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:11.005006 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.005293 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.005572 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] PATH_INFO: `/v3/projects/7403b38bcf364a7386168d090a90a6dc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.006774 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7403b38bcf364a7386168d090a90a6dc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:11.008718 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:11.055678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7403b38bcf364a7386168d090a90a6dc', 'request_id': 'req-3ae82554-1b80-4c78-b343-00e9c041da1d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.062940 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7403b38bcf364a7386168d090a90a6dc', 'request_id': 'req-3ae82554-1b80-4c78-b343-00e9c041da1d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.068687 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7403b38bcf364a7386168d090a90a6dc', 'request_id': 'req-3ae82554-1b80-4c78-b343-00e9c041da1d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.076433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:11.081176 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] The token cache is being invalidate because project 7403b38bcf364a7386168d090a90a6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:44:11.081558 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.082582 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.084383 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1447/2872] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:44:10 2022] DELETE /identity/v3/projects/7403b38bcf364a7386168d090a90a6dc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:11.088366 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:11.089769 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:11.102984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb7cf-406e-4ad8-83e9-08806f0a9fea admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:11.163091 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:11.164003 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.164281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.164555 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] PATH_INFO: `/v3/users/71b35251f2804882aac9a9d7d9928783` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.165738 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b35251f2804882aac9a9d7d9928783)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:11.167643 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:11.213090 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b35251f2804882aac9a9d7d9928783'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.220390 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b35251f2804882aac9a9d7d9928783'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.230822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:11.233603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b35251f2804882aac9a9d7d9928783'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.235168 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b35251f2804882aac9a9d7d9928783'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.245700 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ff785664-6f1a-41eb-8f07-17b8c9d55172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b35251f2804882aac9a9d7d9928783'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.252499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1426/2873] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:44:11 2022] DELETE /identity/v3/users/71b35251f2804882aac9a9d7d9928783 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:11.532156 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:11.533778 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:11.548960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae82554-1b80-4c78-b343-00e9c041da1d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:11.611019 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:11.611834 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.612121 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.612402 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] PATH_INFO: `/v3/projects/6b9433703ac747aea02936a23902a7af` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.613611 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9433703ac747aea02936a23902a7af)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:11.615538 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:11.663947 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9433703ac747aea02936a23902a7af', 'request_id': 'req-a8c8d2df-8eb7-47c0-893c-9b63b222077c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.671149 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9433703ac747aea02936a23902a7af', 'request_id': 'req-a8c8d2df-8eb7-47c0-893c-9b63b222077c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.677302 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9433703ac747aea02936a23902a7af', 'request_id': 'req-a8c8d2df-8eb7-47c0-893c-9b63b222077c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.688784 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] The token cache is being invalidate because project 6b9433703ac747aea02936a23902a7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:44:11.689070 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.689710 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a8c8d2df-8eb7-47c0-893c-9b63b222077c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:11.691244 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1448/2874] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:44:11 2022] DELETE /identity/v3/projects/6b9433703ac747aea02936a23902a7af => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:11.696140 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076df5-d573-4feb-b381-107676556050 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.696427 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076df5-d573-4feb-b381-107676556050 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.696705 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076df5-d573-4feb-b381-107676556050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.715250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9f076df5-d573-4feb-b381-107676556050 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:11.716505 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9f076df5-d573-4feb-b381-107676556050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:11.776428 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1427/2875] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:11.785441 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.785727 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.786005 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.804450 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:11.805652 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:11.814016 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1449/2876] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:11.818305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f076df5-d573-4feb-b381-107676556050 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:11.830257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f076df5-d573-4feb-b381-107676556050 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:11.834937 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:11.835607 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.835926 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.836206 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.836941 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 09:44:11.837257 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:11.838864 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:11.850834 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1428/2877] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 20 09:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 09:44:11.855155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:11.864624 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195627f-ce45-495b-bad6-84f615f6f7e5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:11.869332 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:11.869965 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.870255 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.870525 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.871217 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:11.873133 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:11.901555 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1450/2878] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 20 09:44:11 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:44:11.905668 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:11.916207 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a07ab6-bd50-463b-8e30-db0e2f869379 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:11.974850 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:11.975524 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:11.975838 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:11.976112 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:11.976804 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:11.978857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:12.000496 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1429/2879] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 20 09:44:11 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 09:44:12.004664 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:12.016304 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58c02e-1e04-4890-a76c-35534be7a173 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:12.021866 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:12.022543 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:12.023073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:12.023368 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:12.024135 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:12.025763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:12.037168 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1451/2880] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:12.041335 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:12.052177 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fb21-6180-4da0-8486-ce3c6e57249c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:12.056869 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af406ea-87a1-4bcf-8f66-e93f24c8044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:12.057536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406ea-87a1-4bcf-8f66-e93f24c8044f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:12.057821 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406ea-87a1-4bcf-8f66-e93f24c8044f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:12.058099 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af406ea-87a1-4bcf-8f66-e93f24c8044f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:12.058860 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af406ea-87a1-4bcf-8f66-e93f24c8044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:12.060500 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af406ea-87a1-4bcf-8f66-e93f24c8044f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:12.071551 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1430/2881] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 20 09:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 09:44:12.075562 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:12.085887 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439616-aa68-4a78-a145-a60cf0397cf1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:12.090563 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:12.091445 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:12.091758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:12.092025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] PATH_INFO: `/v3/projects/8b8e487445b541cc95099e7421e0a8a7/users/1f3a0b978652458da2746e647fe3e328/roles/30419c28dd3c4881a47b462c6717a79e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:12.107889 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8e487445b541cc95099e7421e0a8a7, user_id=1f3a0b978652458da2746e647fe3e328, role_id=30419c28dd3c4881a47b462c6717a79e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:12.111392 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:12.124175 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1452/2882] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 20 09:44:12 2022] PUT /identity/v3/projects/8b8e487445b541cc95099e7421e0a8a7/users/1f3a0b978652458da2746e647fe3e328/roles/30419c28dd3c4881a47b462c6717a79e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:12.135054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f55ba-4570-4ca7-8d83-079e55dd1cc7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:12.135535 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f55ba-4570-4ca7-8d83-079e55dd1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:12.135637 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f55ba-4570-4ca7-8d83-079e55dd1cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:12.162590 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6a5f55ba-4570-4ca7-8d83-079e55dd1cc7 None None] MFA Rules not processed for user `1f3a0b978652458da2746e647fe3e328`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:12.163831 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a5f55ba-4570-4ca7-8d83-079e55dd1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:12.204466 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:12.230499 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1431/2883] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:12.242112 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:12.244848 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:12.282405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:12.311377 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e24d-617c-40f3-9d9b-d0bb6b3a75b8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:12.315978 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692e37-9a91-4621-a731-e8310424a20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f96e51cfa14f148a5dd3ebd18f591c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:12.316630 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692e37-9a91-4621-a731-e8310424a20f service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:12.316910 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692e37-9a91-4621-a731-e8310424a20f service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:12.317181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692e37-9a91-4621-a731-e8310424a20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:12.325731 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5692e37-9a91-4621-a731-e8310424a20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:12.327150 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5692e37-9a91-4621-a731-e8310424a20f service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:12.335865 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1453/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:13.696384 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:13.696898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:13.697011 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:13.714333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] MFA Rules not processed for user `1f3a0b978652458da2746e647fe3e328`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:13.715533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:13.722432 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1432/2885] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:22.332250 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=14 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:23.709190 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=12 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:27.257561 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72f34-c41c-44e8-bbef-1844dba94e69 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:27.258040 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72f34-c41c-44e8-bbef-1844dba94e69 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:27.258155 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72f34-c41c-44e8-bbef-1844dba94e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:27.286439 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e2f72f34-c41c-44e8-bbef-1844dba94e69 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:27.287631 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2f72f34-c41c-44e8-bbef-1844dba94e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:27.368852 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1454/2886] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:27.417871 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:27.419299 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:27.489453 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc540509-d10f-4380-9708-abf6072f5932 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:27.494488 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:27.495138 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:27.495423 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:27.495701 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:27.503820 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:27.505388 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:27.513650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1433/2887] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:44:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:44:28.025362 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc2616-2760-4cf6-a68d-1306cd1f9f5a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:28.025678 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc2616-2760-4cf6-a68d-1306cd1f9f5a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:28.025980 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc2616-2760-4cf6-a68d-1306cd1f9f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:28.044527 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-47fc2616-2760-4cf6-a68d-1306cd1f9f5a None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:28.045758 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-47fc2616-2760-4cf6-a68d-1306cd1f9f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:28.059844 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1455/2888] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 20 09:44:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:44:28.072633 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:28.084215 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4baa42-081d-4611-8360-babaf2a88d2d service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:28.089358 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:28.090001 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:28.090288 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:28.090566 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:28.098760 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:28.100370 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:28.108832 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1434/2889] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:44:28.342379 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed634b7-6911-4d7a-bf23-4a967bf11dd3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:28.342943 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed634b7-6911-4d7a-bf23-4a967bf11dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:28.343294 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed634b7-6911-4d7a-bf23-4a967bf11dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:28.364585 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fed634b7-6911-4d7a-bf23-4a967bf11dd3 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:28.365756 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fed634b7-6911-4d7a-bf23-4a967bf11dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:28.373084 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1456/2890] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 20 09:44:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:28.385376 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:28.396317 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4dba5-ffaa-449a-95d6-2222a15f6f13 service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:28.401960 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:28.402621 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:28.402908 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:28.403187 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:28.411790 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:28.413361 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:28.422674 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1435/2891] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:44:28.761876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:28.762159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:28.762435 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:28.780649 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] MFA Rules not processed for user `81e2cdcf476e40039b7839b529f0ebeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:28.781838 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:28.788991 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1457/2892] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 20 09:44:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:28.802229 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:28.813208 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85df8d-27c5-404d-8f38-524faed8d776 service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:28.818383 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a2fbc-e945-4f5e-8e4a-49098e751a6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eaddc698594f328d27c7e3c7bf6a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:28.819024 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2fbc-e945-4f5e-8e4a-49098e751a6d service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:28.819305 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2fbc-e945-4f5e-8e4a-49098e751a6d service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:28.819603 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2fbc-e945-4f5e-8e4a-49098e751a6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:28.828614 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a2fbc-e945-4f5e-8e4a-49098e751a6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:28.830256 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a2fbc-e945-4f5e-8e4a-49098e751a6d service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:28.839027 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1436/2893] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 20 09:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 09:44:30.975111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:31.041181 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1689fd-f4c5-4745-bbb4-8ceba07b8703 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:31.046398 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00450384-0713-417d-be01-7de862c2339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:31.047285 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00450384-0713-417d-be01-7de862c2339e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:31.047567 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00450384-0713-417d-be01-7de862c2339e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:31.047883 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00450384-0713-417d-be01-7de862c2339e admin admin] PATH_INFO: `/v3/users/1f3a0b978652458da2746e647fe3e328` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:31.049106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00450384-0713-417d-be01-7de862c2339e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3a0b978652458da2746e647fe3e328)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:31.051024 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00450384-0713-417d-be01-7de862c2339e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:31.097626 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3a0b978652458da2746e647fe3e328'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.105077 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3a0b978652458da2746e647fe3e328'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.117971 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3a0b978652458da2746e647fe3e328'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.118634 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3a0b978652458da2746e647fe3e328'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.119854 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:31.127622 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3a0b978652458da2746e647fe3e328'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.134591 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1458/2894] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:44:30 2022] DELETE /identity/v3/users/1f3a0b978652458da2746e647fe3e328 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:44:31.139502 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:31.140075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:31.140075 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:31.158347 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] MFA Rules not processed for user `b23a970af9624514b8673afe5569bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:44:31.159540 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:31.219915 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1437/2895] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 20 09:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:44:31.229604 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:31.231111 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:31.309598 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00450384-0713-417d-be01-7de862c2339e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:31.313536 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:31.314187 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:31.314473 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:31.314750 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:31.324071 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:31.325502 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:31.335823 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1459/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:44:31.518810 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:44:31.520315 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:44:31.533452 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8e479-b3a6-4539-a9b4-6a6487c5333c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:44:31.539212 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:44:31.540176 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:44:31.540529 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:44:31.540805 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] PATH_INFO: `/v3/projects/8b8e487445b541cc95099e7421e0a8a7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:44:31.542696 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8e487445b541cc95099e7421e0a8a7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:44:31.545157 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:44:31.594986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:31.599265 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8e487445b541cc95099e7421e0a8a7', 'request_id': 'req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.608763 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8e487445b541cc95099e7421e0a8a7', 'request_id': 'req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.614495 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8e487445b541cc95099e7421e0a8a7', 'request_id': 'req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.626026 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] The token cache is being invalidate because project 8b8e487445b541cc95099e7421e0a8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:44:31.626311 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.626962 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:44:31.628650 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1438/2897] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:44:31 2022] DELETE /identity/v3/projects/8b8e487445b541cc95099e7421e0a8a7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 09:44:41.331268 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=40 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:41.622546 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:08.197807 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:46:08.199224 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:08.211258 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356526-defc-43e4-b7ca-51600015d19d service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:46:08.261505 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:46:08.262405 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:08.262686 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:08.262962 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:08.264789 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:08.351035 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:46:08.352511 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2407e-c6d4-4c18-9dd7-20a6a893b96b service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:46:08.374367 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1460/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:46:09.545415 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:46:09.546857 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:09.559909 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ddd42-1ed2-4193-bf2c-c4dec552b7b1 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:46:09.563574 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:46:09.564254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:09.564541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:09.564822 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:09.566625 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:09.580375 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:46:09.581970 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee906cd-0902-4995-9250-a04d35b95def service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:46:09.594755 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1439/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:46:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:46:18.371053 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=63 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:19.589552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:20.357209 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5fd0c-d89c-46e0-b202-b72623fc8ea1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:20.357802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5fd0c-d89c-46e0-b202-b72623fc8ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:20.357802 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5fd0c-d89c-46e0-b202-b72623fc8ea1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:20.359581 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1461/2900] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:46:20.366431 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7c50-4db8-40e9-84df-5c7c32dff679 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:20.367054 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7c50-4db8-40e9-84df-5c7c32dff679 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:20.367333 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7c50-4db8-40e9-84df-5c7c32dff679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:20.386567 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-85de7c50-4db8-40e9-84df-5c7c32dff679 None None] MFA Rules not processed for user `e8fa8ef7d61f483db27148b5e316db3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:46:20.388236 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-85de7c50-4db8-40e9-84df-5c7c32dff679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:20.395616 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1440/2901] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 09:46:20.410048 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5fd0c-d89c-46e0-b202-b72623fc8ea1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:46:20.412542 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3fc5fd0c-d89c-46e0-b202-b72623fc8ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:20.426476 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5fd0c-d89c-46e0-b202-b72623fc8ea1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:46:20.430065 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6ef36-e77f-4175-9a5b-59b491a6184f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:46:20.430712 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ef36-e77f-4175-9a5b-59b491a6184f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:20.430998 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ef36-e77f-4175-9a5b-59b491a6184f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:20.431275 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ef36-e77f-4175-9a5b-59b491a6184f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:20.439305 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6ef36-e77f-4175-9a5b-59b491a6184f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:46:20.440763 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6ef36-e77f-4175-9a5b-59b491a6184f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:46:20.449671 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1462/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:46:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:46:20.536327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2608d-f332-40e7-8097-52a1c2f7e0cb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:20.536620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2608d-f332-40e7-8097-52a1c2f7e0cb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:20.536904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2608d-f332-40e7-8097-52a1c2f7e0cb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:20.538355 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1441/2903] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 20 09:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 09:46:20.543813 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:20.544106 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:20.544385 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:20.581015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] MFA Rules not processed for user `aebe4b5d4c0c40218341971859875d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 09:46:20.582944 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:46:20.593788 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1463/2904] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 20 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 09:46:20.604281 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2608d-f332-40e7-8097-52a1c2f7e0cb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:46:20.615528 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2608d-f332-40e7-8097-52a1c2f7e0cb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:46:20.619246 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:46:20.619932 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:46:20.620214 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:46:20.620485 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:46:20.631472 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:46:20.633020 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:46:20.644364 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1442/2905] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:46:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:46:30.578490 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=15 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:30.639536 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=9 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:17.193914 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:17.203921 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d037f9-e688-408c-b75d-788e9f1cd8f8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:17.207520 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8fa8ef7d61f483db27148b5e316db3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:17.208194 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:17.208479 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:17.208757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:17.210570 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:17.221414 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:17.223127 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:17.232056 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1464/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:47:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:47:27.228009 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:45.671464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:45.673980 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:45.692173 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00718a-d118-4683-975e-9844551cc26c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:45.698570 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:45.700038 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:45.700541 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:45.701041 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:45.703198 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:45.717825 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:45.719620 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:45.735654 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1443/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 09:47:47.816867 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:47.832015 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149df4b-a7e2-43f5-91f9-f8a9ef210d94 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:47.838252 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebe4b5d4c0c40218341971859875d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:47.839025 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:47.839316 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:47.839599 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:47.842163 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:47.856523 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:47.858159 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:47.869284 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1465/2908] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:47:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:47:53.625210 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:53.628297 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:53.726676 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba5a6-6040-4fff-b1c4-dd5ad2c8603e service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:53.732686 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:53.733354 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:53.733628 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:53.733904 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:53.736429 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:53.748426 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:53.750085 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:53.767060 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1444/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:47:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:47:56.799571 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:56.820934 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca14f5-599e-41d5-a7f5-1aabf28b6cd0 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:56.827824 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:56.828757 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:56.829260 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:56.829743 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:56.831960 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:56.845551 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:56.847152 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:56.865126 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1466/2910] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:47:56.876464 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:56.877629 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:56.945656 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f46f-622b-43db-b254-dc3866932ae9 service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:56.950327 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:56.951202 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:56.951483 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:56.951783 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] PATH_INFO: `/v3/users/05589f6be4c646aca4fbba4e2909f009` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:56.952984 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=05589f6be4c646aca4fbba4e2909f009)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:56.954898 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:56.999134 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05589f6be4c646aca4fbba4e2909f009'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.006647 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05589f6be4c646aca4fbba4e2909f009'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.021902 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05589f6be4c646aca4fbba4e2909f009'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.023414 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05589f6be4c646aca4fbba4e2909f009'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.030047 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:57.032451 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05589f6be4c646aca4fbba4e2909f009'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.040579 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1445/2911] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:47:56 2022] DELETE /identity/v3/users/05589f6be4c646aca4fbba4e2909f009 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:47:57.214574 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:57.227969 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9c2e-f958-4abd-a956-729101b16b90 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:57.286765 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:57.287628 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:57.287946 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:57.288226 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] PATH_INFO: `/v3/projects/fc16ad037e954656a405c4ebc2ccd9c2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:57.289408 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc16ad037e954656a405c4ebc2ccd9c2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:57.291308 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:57.336700 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc16ad037e954656a405c4ebc2ccd9c2', 'request_id': 'req-cd7f1100-100b-4436-86ce-dc9e6f320f45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.344526 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc16ad037e954656a405c4ebc2ccd9c2', 'request_id': 'req-cd7f1100-100b-4436-86ce-dc9e6f320f45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.350123 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc16ad037e954656a405c4ebc2ccd9c2', 'request_id': 'req-cd7f1100-100b-4436-86ce-dc9e6f320f45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.361641 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] The token cache is being invalidate because project fc16ad037e954656a405c4ebc2ccd9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:47:57.361928 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.362573 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.364138 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1467/2912] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:47:57 2022] DELETE /identity/v3/projects/fc16ad037e954656a405c4ebc2ccd9c2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:47:57.368250 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:57.369552 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:57.382533 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b6680-7f1d-40ac-a7d4-441eb39120ce admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:57.438293 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:57.439163 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:57.439443 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:57.439740 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] PATH_INFO: `/v3/users/0ec37bc992e64432a66c02fdd7a0d3cf` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:57.440944 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec37bc992e64432a66c02fdd7a0d3cf)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:57.442841 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:57.490416 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec37bc992e64432a66c02fdd7a0d3cf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.498008 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec37bc992e64432a66c02fdd7a0d3cf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.509986 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec37bc992e64432a66c02fdd7a0d3cf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.510641 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec37bc992e64432a66c02fdd7a0d3cf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.518254 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec37bc992e64432a66c02fdd7a0d3cf'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.524195 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1446/2913] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 20 09:47:57 2022] DELETE /identity/v3/users/0ec37bc992e64432a66c02fdd7a0d3cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:47:57.707544 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:47:57.709618 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:47:57.725073 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f1100-100b-4436-86ce-dc9e6f320f45 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:47:57.785433 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23a970af9624514b8673afe5569bf18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c023b716ed04429bdfefdcd2624fe52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:47:57.786431 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:47:57.786780 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:47:57.787247 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] PATH_INFO: `/v3/projects/b74e76058189428bb77778f8b252d6fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:47:57.788714 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74e76058189428bb77778f8b252d6fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:47:57.791033 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:47:57.798530 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:57.841876 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74e76058189428bb77778f8b252d6fc', 'request_id': 'req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.849665 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74e76058189428bb77778f8b252d6fc', 'request_id': 'req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.856790 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74e76058189428bb77778f8b252d6fc', 'request_id': 'req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.868047 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] The token cache is being invalidate because project b74e76058189428bb77778f8b252d6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 09:47:57.868339 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.869018 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b2fd6b42-cd0b-4f26-a416-8a112e9415b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 09:47:57.870583 dv-cinder-822822-3-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1468/2914] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 20 09:47:57 2022] DELETE /identity/v3/projects/b74e76058189428bb77778f8b252d6fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 09:48:07.520743 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:07.864907 dv-cinder-822822-3-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:49:11.495470 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 09:49:11.496956 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:49:11.611252 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a4ff-2437-4242-9bc7-1ddd8853729b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 09:49:11.681747 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad02dfcd1184ef690f171ac4410381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffec6317780a4fdeb84706157bed3829', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 09:49:11.682413 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 09:49:11.682703 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 09:49:11.682979 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 09:49:11.684912 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 09:49:11.697759 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 09:49:11.699425 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08501391-1e23-4549-ba37-0e99492ba598 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 09:49:11.709848 dv-cinder-822822-3-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1447/2915] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 20 09:49:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 09:49:21.705351 dv-cinder-822822-3-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=58 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}